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students, parent counseling, and communication skills. Data on the 
effects of the inservice teacher training on student classroom 
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tt^chniques was compared with the effectiveness of teachers who had 
not received contingency management training, and the results of 
standardized achievement tests were analyzed to assess the effect of 
student behavior change on academic achievement. It was found that 
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Mr. Wayne Ellis Bradshaw 
Assistant Superintendent 
Dothan City Schools 
PoBt Office Box 1188 
Dothan, Alabama 36301 

Dear Mr* Bradshaw: 

HumRRO Division No. 6 is pleased to submit this final evaluation 
report covering the third and last year of operation of the Dothan 
City Schools Title III Project, "Comprehensive Services for Children/' 
The report summarizes the results of the project *s third year and 
provides an overview of the entire three years of the projects 
operation. 

The project succeeded because of the dedicated efforts of a 
large number of people, both within and without the Dothan City 
School System, The prime contributors to the success of the project 
were the elementary school teachers in the Dothan City Schools, It 
has been a pleasure for us to work with them, as well as to work 
with the Superintendent, with his central staff and with you and 
your project staff. I would like also to acknowledge the contribu- 
tions of numerous individuals from various universities, the State 
Department of Education, and other governmental and non-govemaental 
agencies . 

We noted last year that the recognition this Title III Project 
had received in both state and national evaluations was a testimony 
to its effectiveness as an innovative educational program. The 
current evaluation report continues to reflect the effectiveness 
of the program. 

The various HumRRO staff members who have been associated with 
this project are listed in the Preface to the report. On their 
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Mr. Wayne Ellis Bradshaw (cont'd) 



30 August 1974 



behalf and \:hat of the Human Resources Research Organisation I would 
like to thank all who participated In the project and In the evalua- 
tion. 



Sincerely yours, 

[a/ ^^Jry^Lc^ 



WWPtab WALLACE W. PROPHET 

Enc. Director 
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PREFACE 

This report presents the evaluation data for the third and final year 
of thi* Di^than City Schools Title III project, "ComprehenBive Services for 
Children." The project, which was planned for completion at the end of three 
vears, han been conducted in accord with that plan^ and the present report is 
the final evaluation to be submitted for the project. While the bulk of the 
data presented are for the project's third year, considerable reference is 
made to data from all three years of the project » The report seeks to pro- 
vide an overview of the results and implications of the entire three years of 
operiat ion. 

Over the project's three years, there have been many persons who have 
been involved with the project in a variety of waye . Thanks are due to all 
of tfiem, especially the more than 200 ele^nentary teachers and principals in 
thi Dothan City Schools who have worked hard and endured much in their support 
ol the project's activities. The objective ol the project has been to aid 
i*lomentary students who suffer socio-emotional conflict problems through 
speci:5l teacher training. This objective has been accomplished through the 
efforts of the teachers. 

In addition, the evaluation staff wishes to express its appreciation to 
the Project Director, Mr. Wayne Bradshaw, to Mrs. Ann Mobbs, to the project 
staff members who labored long and hard, and to Mr. Sam Price Jones, Super- 
intendent Schools, and to his staff for their cooperation and support. 
Finally, special thanks are due the housewives who contributed greatly to the 
project in the gathering of data. The Comprehensive Services for Children 
project has been an example of a broad spectrum of community participation 
In a pro)i^ram designed to improve services to its citizens. 

Over the three years of the project a number of HumRRO personnel have par- 
ticipated. These include Dr. Johnnie Bilbrey, Mr. H. Alr^n Boyd, Dr. Paul W. Caro, 



Dr. Joanne DufUho, Mr. L. Paul DuHlho, Mrs. Katherlne Paulk, and Dr. Waliace W. 
Prophet. During the third year, Dr. Bilbrey, Mr. Boyd, Mr. Dufilho, and Dr. 
Prophet have been responsible for HumRRO participation and the evaluation. 
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I . EXECUTIVE S'JJftt.^'i * 

Thi» rtport &«aa*rijc» tht •£tiv;t:t« rct.ltt 5: th* third *n4 fltiAl 
y«*t of the DothAii City School* ?ro*«ct, " C«;^rth«=4;v« S«rv;c«» for Children.'* 
In addition to pre»entiag the thire-yeAr re«,.:t»» tr.* re-sort pr«««ati «v*lu- 
*tive comments covering the entire thr«« rc«r» ti t*« prefect . 

The Comprehensive Service* pro;ec: r.w^ :'cc^ec cc the provietoa of »peci*l 
tervices in tseetmg the need* of elea*ct*r>- *thccl chilirei sufferlaj eocio- 
emotlonel conflict . These service* «.r« prcv:cec thrc^jh the prlaary aechenisa 
of special in-»ervic4- treiniag for teacher* esc tr".r*.;gh special resource etaff 
n»emi>«r» and contuitant* vho workeo vith the teacher* cx *t«4«35t probI«aui. The 
principal outcome variable exaamcc ha* tttz. »t^«ct claAsroc© behavior that 
could be conceptually related to socio-eajctiozal cc-aflict. 

The project w«» planned to operate ccIt for a perio-d of three year*. Durinf 
the planned three year* of operation it ac-^it eatailith a aechanlam or program 
for providing service* to conflict etoaest* that c^-li costxs;^* to operate to the 
benefit of the sy*teffi *fcer the tcntlnaticc cf tne prefect. This feature of 
deeignlng program* thet can continue to rper*:< a-tcKraoc-Jily after the »pecial 
project haa been completed 1* »o»etiae» referres tc a* "f^rzkeylng." As noted, 
the program model of the Cottprehen*ive Service* ?ro*ec: relie* basically on pro- 
viding aervicea within the regular cla»»rj>c« and priaarily through the cla*»room 
teacher- Thus, the children reccivitig *uch »erTtce* are retained in the educational 
nainatreaa with their peer* rather than be »in,gle<: 3ut •egregatcd for apecial 
treatment. In many re»pect*, the pro:ec: is jisilar tc tne re«o%;rce teaching 
concept that le receiving much attention m ipecial ec^cation circle* a* an 
alternative to self-contained cla**rc^oa m wr^icr. <xce?ticcal children are 
tegregated from their peer*. 

The project utiliied an approach cf *eejK.i=4, ever :t» three year*, to provide 
the apecial traininf to an increaalng nuab«r cf Itotr.ar elementary schoolteacher*, 



wxih the witlmAtc goml btitig to hmvt mil ilifesitntary tftachtrs th« »y€t«s r«r€* i 
th«j »pe%.XAl in-i*ervice traiaitig, Vhilt this wltksAt* $0*1 uot <juit«? mcti€v^z^ 
all bvt 22 of tht *ytttm'i 196 tl^fttntAry tMchers h*d» la f*ct » r€c#lvec all 
pottuHii ot tht in-tervict program by th* «ja4 cf rht thirc ye^r- Tht first y»*r 
*6 clAi»&rooa tt*cheri receive the tr^laiixi, while 52 p^^rtlclp^tec the i^e^^c 
yemr During the final year an additlotiail IQ5 teachers participate^,^ Thus, 
the project achieved one of Itt aaln goali ^ the turokeyisg icco the Dctha:: Zit^ 
Swhooia for the long-term benefit of the tyatea the akilla kaovlecge acq^^lreic 
by the project partici|mnt». 

Thn project waa conducted generally in accord vith ita ba^ic plan aad deisigr. 
would be expected in a large-scale ^ issultl-year program, chA:s4es vera uetfcssarT, 
but the baaic prograta structure retatniKi ita general integrity. So®e alt«rat::ox:.s 
were made xn the in-service training baaed on c^s-.^lativt project experiezices • mzxc 
4 hangei* were made in the data collection ^ as neceaaary. Hovever, the basic cocter. 
of the in-service training remained generally the aase, the aethoc for selecting 
t<irget student iubjects remained conatant> and the principal ;^ata cf interest, i t 
jupe^lt clataroom behavioral obaervaticnis, regained the sas* throughout . 

Viewing the accuaulated data of the project's three yaara, it ca:i be contence 
that desired changes in student behavior were brought about as a function cf the 
special teacher training* These changes are change* that would logically be rela: 
to a leii&ening of student conflict probletc*. It should be noted that the princip*. 
a<4ta are objective^ Independent (i.e, > Independent cf the teacher! observations c: 
speciiic classroom behaviors of students rather than student state;nent-s c: tr.e:r 
reelings or teacher opinions concerning the degree of conflict present m tr.e.r 



This totals to 183 program participants. This plus the 22 ncn-^par ticipaz:^ 
totals 205. The discrepancy between this figure and the elenentary teacher 
population N of 198 cited is due to previous years* participants who have left 're 
system. 



t;.^«t:i» In reliance on ind«fpea<i«at clJtkMSTOo;^ ttT,Av*^ZTml ct*€r\Aticcs , 
tu« :5r-5:ect, nfhilt p«rh4p* net uai«;u€> i* unusual. Tht b«^•*vl2rAl criteria 
v«r« %tdttea '^a «^Y«ic« anc ver« t.d,*^.ere4 tc thrc^gr.c^^t tre ?rcj«c:'s tr^ree ye^rs* 
rh# Cd^t* support tt^ genera; conclutiot: t^at tht *p^^c*al *r:-5€r^•lc« training 
?r*jvice ta« teacher* skill* vhic^ they applies acr.^ievin^ a recuctirn c: 
-^a;rcTcrri4t« ::enavicr by their students vhc exhi^;tec ^^tzititrz $r-|;ns of enioticnal 
^^■n:,..:t. ?ui:th«r, t>.€ data incicate the technique* ^'^ere ^eful in vcrkin^ with 
t"'* range of c^.llc^ren in their classroots*. Squally iicfcrtant la the finding 

t^o.: ir.ej^« 3«na:its continue tc accrue in thd systen m tr.e year^* beycnd that in 
^nicn t.^.e ^3^?eclal training was provicec the teacher. Prcbaily a factor of central 
:.:spcr-4nce tr.e m-tiervice training va& the fact tr.a: pcrticns cf that training 
r«^c---rea t.nat tt^e teacher actually u6*e the clasj>roon as an application laboratory 
- - .-:-i^rvi:e :rainin^. In other vcrcs, the participants cic net nerely talk 

4C :ut -i^H ^*aj*^*rocffi techniqaes; the prcgr&s requirec that they 'use thess actively, 

?r"Cgr^ r^ac its shortccming toe. It i& otvicus tr-at a* ncre and siore 
z^^^r.^r^ *ere srwUg^t mtc tne program;, the newer participants see:n*c to benefit 
.e:*^ ;::an lie tne earl:.er ones* Thij^ is a likely ccn4^eq-.ence of jt^u, in--service 
^r^^raa mvxj^viag all teachers. Equal benefits are not derived iy all participants, 
(inu trie earlier volunteers will tend tc benefit Dcre tr.an tr.e later participants. 

itatec. It is felt that any sin^gle in-^service prcgraa; vc-JLd experience a similar 
rvsdfc^-**. anu it is ccnc^uced that in"*service training prcgracis s^Ci»,»^c ce mcividu'^ 
a.;.5^ tc :it tne neecs, interests, anc capabilities cf mcivic-^l teachers- However, 

;s r«c-jgni«ed t^*at aotc schoci systec^s are severely Iiitited m the extent to which 
i".^"' ;an cevelcp incivicualizec m-^service prcgras^ tr.at are tr"cly effective. Their 
r %2ic >*r w are typ.*«ca^^y insui i.«i.ci*tnt tc ccnnuct suc^ pre grants e*tective*.y * s*cn3e'^ 
;uttr::./. in-sarvlec prograsw s.ay be required tc rely cn cccccn sa^s training prograa? 
:r ^<;^^e3 c: cemcns tratcu effectiveness w*hen usee :n a sy*tea?-vice basis. The 
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iGifivltAblij! re*ult, though, will be thmt some will benefit tcuch, and soc*e little 
or not at all. 

Another ^rea ia which the present project did not achieve demonstrable benefits 
was academic achievement. While it w«8 not strongly anticipated in advance that 
teacher traiuiug aimed at techniques for dealing with socio-esiotionAl conflict 
prcbleicia would have a major effect on student achievement ^ there was reason to 
believe chat modification of the inappropriate classroom behaviors resulting froc 
such conflict might be accompanied by improved academic performMice* No such effect 
wajs found on a group basis, though it was clear that the children meeting the criteria 
established in this study as defining socio-'emotional conflict are underachievers when 
compared with their non-conflict peers • In spite of the lack of major group effects, 
there were aumeroua instances in which individual students exhibited major gains in 
achievement as a result of teacher applications of their special training. 

In summing up the project's three years, the data ?*upport the conclusion that 
the general program model used is effective in improving the classroom behavior of 
stwdeniSF with emotional conflict problems* The strength of the program lay in the 
combination of conscientious teachers working with central resource staff members 
and the project administrative personnel, and with outside consultants, on a specific 
class of student problems, A key aspect of the in-service training in producing 
significant classroom behavior change, and in sustaining that change over tima, was 
tne extent to which the in-service training required the teacher to use her ovn 
classroom as the laboratory in which to practice what she was taught. It is felt 
that this is a significant contrast with most in-service training programs in which 
there is nc necessary application of the new knowledge and no specific yardstick 
that the teacher and the in-service staff can use in assessing the results of the 
teacher's application or non-application or that training. In the present case, 
application was required, and the behavioral criteria were very explicit and prcv:dci 



feedback to both the tracher and in-service staff on the results of that application 
The Comprehensive Services fur Children project has left an imprint on the Dothan 
elementary schools in the form of teachers with new skills » new tools » and new 
understanding. While not every teacher nor every child can be said to have benefitted, 
Che net product of the project is claarly positive # 



II. IMPLICATIONS AND RECOMMENDATIONS 



Based on the accumulated data and experience over the three years of this 
project I a number of recommendations are offered for consideration. These 
recommendations arc based on the ImpiAcationa of this project with reference 
to m^an^i of better meeting the needs of children with socio-emotlonal conflict 
problems and the real-world constraints of what is possible in a school system 
such as Che Do than City Schools. Also discussed are certain of the process aspects 
of meeting those needs. The adoption and implementation of these recommendations » 
or variations thereof^ would be the final step in tumkeying the results of the 
Comprehensive Services project to the continuing ^ long-term benefit of the Dothan 
City Schools. In addition ^ these recommendations have obvious relevance to other 
school systems^ and they should be of interest to the Alabama State Department of 
Education and other educators. 

Each recommendation is accompanied by an expository discussion concerning 
background for the recommendation and some details of its Implementation. The 
recommendations are as follows: 

It is vecormended that cm adaptation of the program model of the 
Corrjprehenaive Servicee for Children be implemented in the Dothan City Schools 
on a pejy^nent haaia^ 

Discussion. The program approach of this project produced benefit to both 
those students who showed signs of socio-emotional conflict problems and those who 
did not* Thus, it would be of benefit to the entire range of children in the system, 
as well as In helping meet the specific needs of those with socio-emotional conflict 
problems. It is beyond the scope of this report to describe the exact form of this 
implementation. However, the following components are felt to be essential: 
(1) continuing in-service training for teachers, especially new teachers; (2) a 



central resource #taff; (3) a program coordinator, and (4) use of special con- 
sultants* Ideally I the in-service program would be tailored to meet the needs 
of individual teachers* It should focus on providing information and techniques 
that are directly implemcntable in the classroom, and there should be feedback 
on such implementation. The in-*service program should be based on long-term goals 
that are mutually agreeable to the teacher and the system* The central resource 
staff should be trained in depth in the techniques and knowledge areas concerned. 
There should be an emphasis in their training and in their activities with the 
classroom teacher on actually working directly with children* They should be 
active participants with the classroom teacher in the solution of specific student 
problems. They shotild not assume the role of being only armchair experts or side-- 
line observers or advisors. The program must involve a true teaming of the class- 
room teacher and the resource teacher, each of whom brings certain areas of 
strength and unique competencies to bear on the problem at hand. The program 
coordinator is necessary to insure that resources are directed to the proper place 
and that the program fit in with other programs and activities of the system. The 
coordinator should maintain an active information program with the classroom teachers, 
the principals, and the resource teachers. Within the Do than City Schools, the 
coordinator of special education services might well serve as the coordinator for this 
program since the program is concerned with a type of behavioral exceptionality. In 
any event, since it is unlikely that dedicated teacher resources for this program can 
be established in each individual elementary school (though this would be ideal), 
there should be a central program management* The final point concerns the use of 
outside consultants. It is recognized that the primary load in this program must 
be borne by personnel within the school system. However, a Judicious use of outside 
consultants is desirable to aid in solution of particularly difficult problem 
situations, in bringing in expertise in special content areas, and generally, as a 




means of Injecting new ideM into the tyitem and its activitiea, or fuactioaia^ 
*» a catalyst for new ideas. 

2. It ie reocmnendcd that the Exoepticnal Student Bating Fom (ESBF) 
adminiatered regularly at the end of each school year as an aid in identifying 
studenta who may need special services in school. 

Discussion . The ESRF was a component of the procedure used in this 
project to identify those students exhibiting signs of emotional conflict and 
those without such signs. While there were also other parts to this procedure, 
a procedure that produced consistent results over the project's three years, in 
view of the cost in teacher and administrative effort, only the ESRF is recoaaended 
since it is simple and involves little extra work. Ideally » the other ixistruaent* 
would also be used, but they do involve more effort and cost. The information pro- 
vided by the ESRF should be viewed as administratively ccnfidential, thoxigh it ahould 
be accessible to the parents of the children involved, with copies going to the 
principal concerned and to the program coordinator. They can then use the infomatios 
as a partial basis for their initial planning in the conduct of the program's activ- 
ities for the next year. It should be emphasized that the program's operation is in 
no way bound to only the children identified on the ESRF, though they may provide the 
principal students of initial concern. The matter of confidentiality auat be stressed 
to all parties concerned. Every effort must be made to avoid labeling students in a 
way that is prejudicial to their best interests. This recommendation is b^sed on the 
facts that conflict behavior does provide an identifiable pattern and that such 
behavior can be modified in desired directions to the benefit of the child and the 
system. Identifying such children should be only for the purpose of better alloving 
them to receive services that are needed. The point of any such identification must 
always he to assist in constructive change of student behavior, not to provide an 
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explanation or excuse for the continuation Into the future of Inappropriate 
behavior patterns c^f the past* 

3. It is recommended that effort he initiated epeaifioally at enhancing 
the academic perfomance of conflict atudents. 

Discuss ion . As noted in the report, while the Comprehensive Services 
project produced results in terms of decreasing the frequency of inappropriate 
behavior among conflict students, there seemed to be no systematic effect on 
academic performance « It is understandable that teachers are greatly concerned 
about inappropriate behavior on the part of conflict students (or non-conflict 
students as well), because such behavior often Interferes with the conduct of 
instruction and may sometimes Impinge on the rights, property, or persons of 
other students. Development of more appropriate classroom behavior patterns is 
obviously desirable. The project data Indicate, as would be expected, that tha 
conflict students do not achieve as well academically as do their non-confMct 
peers. A more effective means of meeting their academic needs is requir^^d* The 
techniques u^ed in this project for modifying general classroom behavior are equally 
applicable to modifying academic behavior* In fact, on an individual basis some 
teachers achieved truly dramatic changes in the academic performance of specific 
students through use of those techniques. However, by and large, their attention 
with the conflict students was more likely to be focused on changing general class- 
room behavior than on changing academic behavior. In any event, attention should 
be devoted to the academic underachievement of these students « If Recommendation 2^ 
is implemented, the students identified could be examined in terms of their back* 
grounds, psychological characteristics, and previous academic performance, and 
individual strategies and programs could be developed to modify their academic 
performance* 



4. It 18 recormended that a ayBtematic and regular ayetem of aommuniaation 
be eatabliahed to exchange information over all levels of the aohoot syetem. 

D1& CUBS Ion . An obvious necessity to the success of any special program 
in a school system Is that there be an adequate Information flow among the partic- 
ipants • There were difficulties In the Comprehensive Services project that could 
be traced to inadequate or untimely Information flow* In a system the slse of the 
Do than City Schools there should be at least one^ — and preferably more than one^- 
regular and systematic mechanism for such Information exchange. The word "exchange" 
Is Important 9 for Information must flow both up and down the chain from system 
administration to teachers » and even to parents » children* and the community. While 
this recommendation Is offered In the context of Implementing a program of special 
services to children suffering emotional conflict problems , It obviously applies to 
most» If not all» aspects of the school system's operations. There are many points 
of possible constriction In the information flow— the Superintendent's office* the 
program coordinator* program staff* principals* and teachers— but all of these 
persons or agencies have a common goal in a program such as this* the improvement 
of the educational experiences and opportunities of the system's students. 
Information flow Is a necessity to the achievement of that goal. 

6, It ia reaomended that the schedule for adminiatratian of syatem^wide 
standardized achievement tests be revised to an end^of ^school year adminiatation^ 

Discussion ^ This recommendation is made within the context of the needs 
of the special services program described in Recommendation l^^ as well as in a 
somewhat broader context. It is felt that evaluation of the Comprehensive Services 
project was handicapped by the change of achievement testing to the beginning of 
the school year. While this project Is completed* there will undoubtedly be other 
programs and projects instituted by the Dothan City Schools* some large and some 
small* In which academic achievement will be a main variable of concern. Having to 
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wait for results from the first of June until October » or later » seriously delays 
the evaluation of any such program* Tris Is especially critical in prograaa that 
extend from one year to another in which adjustments to the subsequent yearns 
program should be made on the basis of results achieved in the preceding year* 
Another aspect of this matter concerns feedback to the classroom teacher i. The 
teacher Is the principal agent of change and achievement in any school system » 
and I as such^ is in need of timely information on the results of his or her 
interactions and efforts with the students » One of the most important points 
treated in the contingency management workshops mentioned elsewhere in this report 
is the criticallty of timely and appropriate feedback » or knowledge of results » to 
the basic process of learning and the modification of behavior « This point Is 
Just as critical for the classroom teacher in his or her own seXf^evaluatlon of 
the results of that year*s efforts in the classroom* This is a necessary basis 
for constructive change in the succeeding year's teaching* As a final observation 
on this mattert achievement testing must be handled efficiently and in standardized 
fashion* Appropriate test forms must be used» and results must be supplied promptly 
to those who need them^ especially the classroom teacher* 




II 



ni. PROGRAM DESCRIPTION 



The project, "Comprehensive Services for Children," has completed the last 
of the three years for which It was funded. The general nature of the project was 
described In the first year's evaluation report.i.^ There have been certain changes 
in the project objectives ovar the three-year period, so a full description of the 
original project objectives and plans will not be presented here. Instead, the 
descriptive emphasis will be on those areas or aspects of the project in which 
changes have been made. However, a brief description of the project is in order 

as background for the reader who has not read the first-year evaluation report or 

2/ 

the evaluation report for the project's second year.— 

In brief, the Comprehensive Services project sought to develop a better means 
of meeting the needs of elementary school children in the Dothan City Schools who 
had socio-enotional conflict problems of a magnitude sufficient to impair their 
progress or adjustment in school or that of their peers. The mechanisoM to meet 
these needs were the provision of special in-service training for selected teachers 
in techniques and procedures for dealing more effectively with such children and the 
provision of personnel services to the children and their teachers by specially 
trained central staff members. In addition, numerous State, County, and local 
agencies, along with predesignated consultants who represented areas of expertise 
essential to the project, were available to work with the project staff and 
participating teachers. 



Final Evaluation Rejort (First Year) for the Dothan Cit^Public Schools Title 
III Pro;}ect. "Comprehensive Services for Socio-Emotional Conflict ." Institute for 
Development of Educational Auditing, Arlington, Virginia, August, 1972. 

If 

— Second Year Evaluation Report for the Dothan City Schools Title III Project . 
"Comprehens ive Servic es for Children . HuaRRO Division No. 6, Dothan, Alabama, 

July 1973. 
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The basic objectives of the three^ye^tr project were related to activiciesi 
procedures » and mechanisms aimed at assisting children exhibiting emotional or 
social conflict problems In achieving a better adjustment to school and to their 
social and family situations* It should be noted that the term '*socio**"emotional 
conflict** is not used to connote 'Wntal illness** or severe maladjustments While 
the program is designed to assist any such severely maladjusted children, princi- 
pally through referral to appropriate professionals axul community agencies for 
assistance, the great majority of the socio-emotional conflict children of concern 
to the project are exhibiting normal, though not necessarily effective, behaviors 
and affective reactions to the vicissitudes of life and the problems of growing up 
in our society* These behaviors and reactions often may interfere with the progress 
or adjustment of the child, sometimes resulting in behavior that interferes with 
the rights and progress of others, to the extent that the child needs assistance 
from the teacher or others in developing more appropriate behavior patterns and 
more effective coping skills* Thus, the reader should not infer that the children 
who are the subject of this project and this report are abnormal* Rather, they 
represent, by and large, children who tend toward one end of the continuum of normal 
behavior, but who are clearly part of the normal population of school children. 
The reader will note, too, the effort that was made by the evaluation te^ to keep 
the identities of the subject children secure from their teachers, the project 
staff, and even from the Project Director* It was felt to be critical that no child 
as an individual, be labeled in any fashion that might be considered derogatory* 

OBJECTIVES 

The objectives of the project were categorised as follows: (1) student related 
(2) stsff related; (3) parent related; (4) community related; and (5) administration 
related* A brief description of these objective categories follows* 



Th« b««lc objective In thit «r«« was to upgrade the living fkllls of eleaentary 
students with emotional and/or loclal conflict problana through taacher-medlatad 
ciaaaroom management technlquae to enabla thoee studanta to function more effectively 
in the total school setting. Undoubtedly » one can ralate almost any aspect of what 
a child does, thinksi or feels to living skills. However, the intent of the project 
was to assist students in becoming more effective in their ability to cope with their 
o%m problems and to those related to the school environment* Since the schools cannot 
deal directly, at least in any major way, with the non-school background circumstances 
that affect the behavior and affective reactions of students, the project sought to 
provide the teacher the skills and knowledge required to make constructive classroom 
intervention with most students suffering normal conflict problems and to refer those 
with severe problems to appropriate agenciea. Therefore, the major outcome variable 
of the teacher's intervention was to be student classroom behavior change. It was 
Celt that positive behavior changes in the classroom^ and the child's learning that 
appropriate behavior produces favorable consequences, would produce desirable general 
effects. More appropriate general behavior in the classroom might logically be 
expected to result la higher academic achievement, better school attendance, and a 
more favorable image of the student as seen by himself, his peers, and his teachers. 

Staff-Related Objectives 

The general project objective related to staff was to provide usable skills, 
knowledge, information, and understanding regarding conflict to the participating 
teachers through the in-service training pvogram and the services of consultants 
and central staff membera. Professional staff members and consultants utilised 
included educators, psychologists, psychistrists, pediatricians, and social workers. 
The goal of the project, over time, was to develop in-depth expertise that could be 



turnkey^d b^ck into the tytttitt* la^tervic* tr4iais| v*^ c^sigritd tc provide 
t^achera with th* skills And kno^^C^dgt rt^^ixtc to tu^^gt clAS^room situations 
more effectively end to edvence tfee etuce^^^tt' ^>e*t i:itert4i^t^. While thle objective 
involved provildin* knowledge^ infon&etio?;* .^er*tsricin4, acre specifically it 
WM intended to brin^ about chenget teac:^er b*r,*vicr, i-e., the Applicatiot; of 
their nev ekills end knowledge In the cla4^sr>^. 

Parents-Related Objectives 

It was recognised that to be SriLXlaually effective a yr;?|ras; dealing with 
children* a conflict probleiaa muat involve pares: ta. Therefore , asn objective of the 
program was to establiah mechanlK^a for the teacher* a^c the <$ystea to interact with 
parentb more frequently and effectively • >^ring the third year of the project, 
counseling was available vithin the achool letting fcr parents %'ho requested assist-- 
ance with problem* related to their chilcre:^- 

Community^Related Objectives 

Similarly p it was recognized that the invclves^^t cf the overall comunicy and 
its human service agencies would be helpful in si^etln^ the needs cf the children of 
concern. Consequently t a program of agency referral anc pcblic information was 
established* 

Administrations-Related Objectives 

The project was designed to provide the schocl acxmiscra^cion with data on the 
products or results of specific procedures astd actl%*itiea by the staff. Knowledge 
of the costs and relative benefits c: prcgras. alternatives is a necessary part of 
effective management and is an integral par: of accc^ntaiility • 



PROGRAM MODEL 

Studtnt-rtlated obJ«ctlvt» were tht cAStrtl th«a« of th* pr£*«ct, bi;t £l;ei.r 
AchUvement d«p«nde<l on ♦l»o Achieviiif tht •t*if-r*l4X«<i ob'tctiv**. a* pntviout-v 
»t«t«<l, tht prtatry atchtni»a for mtttis^, the** prorcics* cf tht pri!;;tct ob:;«^tiv«6 
WAS aptcial in-»trvlct training for leltcttd teachers. Ihelr tralnls^ begas ir. t±e 
suBuatr, prior to tht beginning of the IS'S-/*. tchocl ytAt, vhen p4rtlclp*tla$ 
tetchtrs ttttndtd « fivt-d«y workshop. Tr*lt4iti$ v** continued thrtsvfhcoit tie schocl 
year, end each ptrticiptclng temcher vat relented free her c:lA*trs«ss ducle* ea« 
school day etch month for elj|ht oontht during the tchool yeer. la tJLl, 105 
teachers participated in the in-tervlce progras Ciiring the 19T3^7% achool year. 
Thit compered to 26 participant* In 1971-72 and 52 in IS'I-TS. Over the 5ka«t thret 
years, almost 901 of the 198 tltaentary ichoolteacheri in the Docnan City Schocls 
participated in this special in-service training. 

During the first year of the project tvo teacher* fros each of the 15 el«a«Ent&ry 
schools received this training, while in tht atccnd year four teacher* frc«£ each schc»; 
were active in the prograa. During the third year, an Attempt va» s^aae tc indu;;*. 
at least in partial fashion, all of tht reaaining tleaentary school teacher » i.n the 
system plus all the teachers who were new in the syatte at tixat rise. The intent 
of the program was to have all elementary schoolteacher* in the Do than City Scnoclt 
participate in the special in-service trainirqj progras by the eat of the thirc year 
of the project. In fact, there were only 22 elessencar^j- teacher* wi-.c iid net partic- 
ipate. Since all elementary schools did net have the saae n-^er of teachers, an 
equal number of participants fros each school va* not postible curing the thirc ye&r 
of the project, as had been the case in the previous rwc year*. The tictr:;E-ticn w»« 
such that three of the schools had i, 7, «sd U participant*, respectively, whtle the 
remaining 10 schools each had 8 participant*. 



\z ztm outage » 105 particijMucit* ^re civice^ fcr th€:.r ia-#€rvic* training 

t^ur groups, chit grouj^^ bailing bAs#d f«ii«r*.lly on tht frAC# lev«I taught. That 

t#«i4;n«r^ CO vl^roui^ 2» rourth-grAd# tMchers to Group 3, 4^ fifth^* slxth-grii4« 
z^j^nnti^ to wtoup ^. Ihi* Arraxigts&ent provicec fcr rtl4tivtly h<^$ta«ou* group* in 
zn^z Che ciwicthia^ techniques ustc by theiif; te4Chtrs, the )^C4^mLZ c«%r€lopcienc of 
'j:,^«ir :*cua«fic*» ana th# g^n^ral probl*®# *acc\mt^i^ lis tiiitir clas^irocTOi wwld b# 
s;»::uiU^r tor tsK^^tt :s«B^«r« of a fivmn group* 

Ia--^«rvic* traiaing for tht third ye^^r of the prc^«:Ct fcllov^ t^tscaciaily th€ 
^«a«r<iJ. acnedule %s was U4itd lu the I5?i*"?3 school ytjjr* All c: th<t above-* 
asitac^aacia grcupa attitadied ti:e flve-^day ir^aervice trair^iog vcrk*h\>ci pricr thM 

cf aichool. However* for che erght cays of isr-*errice traisiing scheduled 
a*ter ^cnccl bega::* they attended > by groups for oce day each agcth {i.e.. Group 1 
nmz "he seccaa Tuesday ^ Group 2 the aecor^d Wecrieacay » ^rcup 3 the third Tuesday , 
azui JcQup ^ Che third Wednesday), This allowed for tche^uliNC topics tc be directed 
tc tne problems characceristic of the grade lev*els representee i:: each group. The 
x^ioxis activities ia the ia-service progras are shown i:: Table 

It w^ll be noted in Table I that 53 of the teachers recalled additional 
Trair:i:sg on coutingency tsanageiaent techxviques during the reliN^^^-tiae daye for 
S«tpt«saer ana October. Contingency aanage^nt» or behavior nodificatioc as it is 
iicaetiaNts called, is a very effective method to aid the teacher in her classroo© 
sana^eoent ana has been offered in all three yea^rs of this project. As vill be 
actea :in the chapter on evaluation design, the 53 teachers ^o received this in--depth 
4c>xiti:^nal wt:ric with consultants on contingency :tanag«&ent vill be referred ::o as the 

Suilding Representative Group. The lesa-inlni; 51 c: the 1C5 teachers vill be 
ritcerrec to as one of the two **Other Teacher** Groups, although they had all the 
• I'-'^er^fice training activities except for the adcitiocal vcrk on contingency 



Table 1 

Schedule of In-Service Training Activities for 1973- 74 
Date Activities 



May 21, '973 

JUy 29, 1973 
June 18, 1973 

Augiiet 20 - 24, 1973 

Aufuat 20 - 24. 1973 

August 20 - 24, 1973 



Eiteblith calender of in-«ervic« training for 
rY74 

Selection of Building Repreaentativaa for n'74 

Conduct Orientation Prograa for Eleaentary 
Prlncipala 

Conuuct One-Day Orientation Program for 
Project Staff and Eleaantary Teachere 

Conduct Tvo-Day Individually Guided Education 
(ICE) Workihop for Project Staff and Eleaantary 
Teachers 

Conduct Two-Day Contingency Manageaent Workshop 
for Project Staff and Elementary Teachers 



September, 1973 

October, 1973 

November, 1975 
January, 1974 
February, 1974 
.Harch, 1974 

April, 1974 

May, 1974 



In-service Activities as follows - typical 
schedule (Substitutes provided and teachers 
are released for a full day.) 

a. Teaching Strategies for Personalised 
Instruction, or Contingency Managemezit- 



V 



b. Reaching and Teaching Culturally Deprlvad, 
or Contingency Managementi.' 

c. The Teacher as a Classroom Manager 

d. Parental Counseling Techniques and Methoda 

e. Coomunlcatlon Skills Workshop Follov-up 

f. Visit Accelerated Learning Achievement Center - 
(Reading and Math. Dothan) 

g. Trip to Visit out-of-city school 
(Exemplary program) 

h. Summary and Critique 



1/ 

Fifty-three of the 105 teachers received further in-depth instruction on 
contingency management techniques on these two days. The remainder received the 
other subjects indicated. 
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maaagtoent. Twenty-two of tht system's 198 elementary teachers did not participate 
In the special in-service program during one or more of the three years of the 
project. This group constitutes tive second "Other Teacher" Group. 

The orientation of the project was to provide teachers with both the specific 
skills to enable them to work more effectively with children who have emotional 
problems and with the general skills that would be beneficial in dealing with all 
children in their classrooms. Accordingly, the project design tended to prevent 
the teachers from concentrating on specific children selected for study by the 
project administration or the evaluation team. While the evaluation design did 
select specific samples of students who exhibited signs of emotional conflict for 
observation and other data collection and analysis, the Identities of these 
chlldr«i were ttwt made available to the teashcrr-or to the project administration 
and staff, Including the Project Director. 
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IV • EVALUATION DESIGN 



Evaluation of a project such as the present one Involves systematic examine- 
at ion of major outcomes « or product variables » of the project. Evaluation is a 
necessary step In the administrative decision process involving examination of 
program alternatives and selecting program models or innovative practices for 
implementation* Just as the administrative decisions involving major program 
changes are complex matters » so is evaluation a complex matter • 

As was pointed out in the previous chaptert the fundamental intention of the 

Comprehensive Services project has been to provide the classroom teacher with 

techniques and knowledge through which he or she can change the behavior , academic 

performance! and affective reactions of students in the classroom* Therefore i the 

emphasis in the overall evaluation for this project has been on student behaviors* 

Teacher opinion > or the opinir^n of project staff personnel » has not been used to 

1/ 

evaluate outcomes » though it is recognized that such opinions are important and 
meaningful. However » the evaluation design stresses data that are relatively 
objective and that are direct indices of or are based upon student behaviors. 

The basic evaluation design adopted at the beginliLng of the three'*yea*« 
Comprehensive Services project has been continued throughout the program. As would 
be expected in any major project conducted in an on-going school 8ystem» it has been 
necessary to make adjustments and changes in both the process activities of the 
project and in the evaluation design. These changes resulted from funding changes » 
from operational experiences in the conduct of the project » from suggestions of 



^ As noted in the discussion of procedures for selecting Experimental and 
Control students » the teacher did provide information used in selecting students. 
However^ such Information was provided by the previous yearns teacher and was not 
used as an outcome measure. 




teachers «nd principals, from adaloltcraCive requirements of the school system or 
the State Department of Education external to (but impinging on) the project, and 
some were natural consequences of the execution of the project over time. Despite 
such modifications, the original design involving (1) special in-service training 
for teachers as the effector mechanism, (2) comparison of various teacher groups 
based on their type of in-service training, and (3) the use of student behavioral 
outcomes as the primary evaluation data has remained constant over the three years 
of the program. 



The evaluation design adopted at the outset of the three-year project was a 
2x2 X 2 design with two treatment groups (teachers), two subject groups (students), 
and data gathered at two points in time (observations). Several different data sets 
were utilized. The primary data were actual classroom observations made by a 
specially trained group of outside (i.e., non-teacher) observers. Since the project 
was limited financially in terms of the number of such observers it would employ, 
it was necessary to sample on both the treatment variable (teachers) and on the subject 
variable (students). In addition, as will be elaborated later, the simple dichotomy 
on the treatment variable suggested by the 2x2x2 design actually involves, in 
this third year of the project, some five identifiable groups of teachers. 

A summary description of the design is as follows. Treatment groupBt in the 
basic design, consisted of two groups of elementary teachers; (1) those who had 
received the special in-service training related to emotional conflict, including 
the contingency management techniques, and (2) those who had not received such special 
training. There were 183 teachers who received the special training over the tnree- 
year period. Subjeat groupa were two groups of elementary school students drawn from 
the 4,608 students enrolled in the Dothan elementary schools; (1) students whose 
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behavior or •«lf-r«port during tht preceding ichool year could be cher&cterited as 
Indicative of significant soclo-emotlonal conflict (N » 510), and (2) students vhose 
behavior or self-report during the preceding school year gave no evidence of «ocio« 
emotional conflict (N • 611). These two groups comprise the two basic subject 
populations from which samples of N • 274 and N - 176, respectively, were dravn for 
the third-year evaluation. Two sets of behavioral obeervatione were gathered, at 
the beginning and end of the 1973-74 school year, respectively. These pre- and 
post-observations of the occurrence of inappropriate behavior were xaade in the 
classroom by 18 observers specially trained for this purpose. The observations 
provided the data for analysis to assess the effects of the special in-service teachi 
training on student classroom behavior. In addition, viirlous other types of data 
(see section on Evaluation Instruments), were used for pre-post comparisons. 

TREATMENTS (Teachers) 

As stated, the two basic treatment, or teacher, groups being compared were: 

(1) the group who received the full program of special in-service training, and 

(2) the group who received no in-service training or whose in-service training die 
not include the special contingency management techniques. The effects of these 
treatments, presumably, would be reflected in actual student behavior, I.e., the 
evaluation looked for effects of the teacher in-service training in the behavior 
of their students rather than In the behavior of the teachers, even though changes 
in teacher behavior might be Inferred from the changes in student behavior. 

Those elementary teachers who received the full special in-service training 
will be referred to in this report as the Building Representative Group, and the 
abbreviation BR will be used. The BR teacher population can be divided into three 
subgroups: BRl includes those teachers who received their special in-service 
training during the first year of the project, 1971-72; BR2 includes those teachers 
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who rcctlv«d luch training during tht ttcond ytar» 1972'^ 73; «nd BR3 includi^B thos^ 
ttachtr» trained during tha projtct*! third yaar» l973-74# 

Thoat alamentary taachars who did not fall in any of the threa BR groups da*-^ 
icrlbad will ba raftrred to a« tha Oth0r Teacher Group ^ abbraviatad 0T» Two OT 
subgroups art dlstingulshsd, 0T4 includas thosa taachsra who racalvad a partial 
in--sarvict training program during tha 1973^74 school yaar, while 0T5 includas 
thosa tsachars who raceivtd no spacial in-sarvica training during any of Cha thraa 
ysars of tha Comprehansive Sarvdcaa pro j act » 

As can be sean» the design traatmant variable dichotomy actually involves five 
different teacher subgroups • This is a natural consequence of the operation of tha 
project over the thrae-year period. Alsot it allows a longitudinal examination of 
the program results* 

Tha reader may protest » with some Justification* that the 0T4 group might 
better have been labeled ss BR4 since they did receive a substantial amount of 
in-service training « However » the principal common feature of tha in-service 
training program of all three BR groups was that each received an in-depth exposure 
to contingency management in which consultants worked actively with the teachers in 
their classrooms on specific student behavior programs * The 0T4 group lacked this 
important training. It should be noted that the continued operation of the In- 
service training over the three years left only a small group of teachers (V, • 22) 
for the OTS group* i*e.» those who had received no in-service training at all« 

In all» some 124 of the system's 198 elementary teachers for the 1973-74 school 
y/^ar fell into the BR groups » as defined^ and 74 fell into the OT groups. As 
previously noted » it was not possible to gather evaluation observation data in 
the claasrooms of all teachers due to financial constraints* Therefore » a 
aampling of teachers from the BR and OT groups was drawn based on: (1) the total 
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nutnber of t*rget »tudtnt« on whoa observational data potentially could be collected ."^^ 
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<2) the dlatrlbutlon of target atudents In the claasrooins of the various teachers » 
(3) r«pr«»entation of the various BR and OT groupings, (A) representation of the 13 
elementary schools, and (5) representation of grades two through six. Figure 1 gives 
a distribution of the nuabers of teachers from the level of the total elementary 
teacher population down to the numbers of teachers in the various BR and OT groups 
in whose classrooms student observational data were collected. Thus 55% of the BRl 
teachers (i.e., 12 of 22) were in the sample, as were 57% of the BR2 teachers, 51X 
of the BR3 teachers, 35Z of the OTA teachers, and 59X of the 0T5 teachers. 

SUBJECTS (Students) 

Two pools of students were identified, Experimentals and Controls. From these » 
the specific students on whom behavioral observations were to be made were selected. 
The Experimental Pool consisted of those students whose previous In-school behavior 
gave some indication of socio-emotional conflict. The Control Pool was selected 
from those students with a clear absence of Indication of such conflict. The 
criteria involve-^ in this selection were as follows: 

Experimental Pool 

Operationally, Experimental students were selected principally on the basis 
of data obtained from (I) the Exceptional Student Rating Form (ESRF) , and (2) the 
Self Observation Survey (SOS). Both of these instruments were completed at the close 



- As is explained in the section dealing with evaluation Instruments, the maximum 
number of students who could have been observed was 5 AO. The actual number observed 
and whose data were used in the analyses reported was somewhat smaller. 

The number of target Experimental or Control Students, i.e., those meeting the 
criteria described In the Subjects section, could vary from zero to five or more per 
classroom. Teachers having the larger numbers of such students were selected for 
inclusion in the teacher samples. 

24 iQ 



I 



BRl 

(71-72) 
N - 22 



BRl 

N - 12 
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BXdg. 
R«pt. 

N - 124 



BR2 

(72-73) 
N*« 49 



ALL TEACHERS 



N - 198 



BR3 

(73-74) 
N - 53 



rOPULATION 



ii A M P L E 



BR2 

N - 28 



BR3 

N - 27 



0T4 
N - 52 



0T4 
N - 18 



Other 
Tt«chers 

N - 74 



0T5 
M - 22 



0T5 

N - 13 



Figure 2. Distrlbutioo of teacher population into taacher 
(treataent) groups and numbers of teachers 
sampled in each of five teacher groups. 



ot the preceding school ye«ir» the former by the student's preceding year's teacher 
^nd the Utter by the student himself. The ESRF is simply « form on which the 
teacher identifies students who exhibit specified types of behavioral exception- 
ality. A specimen of the Exceptional Student Rating Form is in Appendix A. The 
SOS ir.struaer.t was used in lieu of the I'opham Self Appraisal Inventory^ a measure 
of student self-concept, that was used in the student selection process the first 
two years of the project. The SOS^^ is also a measure of self-concept. It was 
used during the third year of the project in accord with an .administrative decision 
of the Project Director since the SOS was being administered to all Dothan elementsry 
students as a part of a nstion-wide normative study. The selettion procedure was 
designed to identify students exhibiting the highest degree of conflict-related 
behavioral exceptionality (as Judged by the preceding year's teacher) and those 
exhibiting the weakest self-concept (as indicated by the student's self report on 
the SOS). Only grades two through six were eligible for inclusion in this study 
since one of the selection criteria (the ESRF) required that a child be enrolled 
in school the previous year. Other selection criteria for the Experimental Pool 
required that the student must CD have received a first-place nomination on one 
or more of the six behavior descriptions listed on the Exceptional Student Rating 
Form, or (2) have a stanine score of _1 (weak self-concept) on any one of the four 
scales of the SOS and have no 8^ or 2 stanine score (strong self-concept) on the 
remaining scales, or (3) have a stanine score of 2^ on any two or more scales while 
having no 8 or 9^ score on the remaining scales. Any second- through sixth-grade 
student who set one or more of the above criteria was assigned to the Experimental 
Pool. The Experimental Pool totaled 510 students, or 133; of the total elementary 

~ For lurther information on the SOS the reader is referred to: 
Institute for the Development of Educational Auditing (IDEA) 
1121 Arlington Boulevard, Arlington, Virginia 22209 
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•nrollsi«nt. Of thest^ 274 st udents w«r« ob»«rved in tht initial data collection 
•ession (pre<*t««t obaervatlon) . 

Control Pool 

Studcnta aelacted for tha Control Pool ware aalactad on tha baaia of their 
Exceptional Student Rating Form and a HunRRO prepared aenantic differential Pupil 
Rating Form (PRF) (see Appendix A). The PRF forn waa conpleted by the prevloua 
year 'a teacher, aa waa the ESRF. For a atudent to be categorised aa a Control, It 
waa required that (1) ha have no nominationa on any of the aix behavioral deacrip- 
tlona listed In the Exceptional Student Rating Fora, (2) have no stanine 1^ score 
on the SOS and not more than one stanine 2 c>n the SOS, and (3) have no 5^, jS, 
or 2 ratinga on the Pupil Rating Form. Alao, the aum of the 2, and 3, ratinga 
received on the 24 itena of thia form muat not have exceeded 16. Of the 611 atudcnta 
(162 of Che total population) who mat the criteria for inclusion in the Control Pool, 
176 were obaerved In the initial data collection aeaaion. 

It was required, in addition, that any atudent selected for eith&r the 
Experimental or Control Pools have complete recorda on the Self Observation Survey, 
the Pupil Rating Form, and the Exceptional Student Rating Form. Studenta who met 
these criteria, but were (1) repeatera, (2) being taught by the aaoa teacher who had 
taught them the previous year, or (3) were acheduled to be elaewhere than in their 
regular claaa when their claaa waa acheduled to be obaerved were excluded from 
aelectlon for either pool. Firat-grade students had no Self Obaervatlon Survey, 
Exceptional Student Rating Form, or Pupil Rating Form acorea since they were not in 
school the previous year and were, thus, not eligible for selection in either pool. 

A third group of students existed aa a by^-product of the aelectlon proceaa, 
those students who fell between the standards set for the Controls and those required 
of the Expcrlmentala. Thia pool of atudents will be referred to as Unclassified. 




Studttntt fron thitt pool wtrc chosen at randon within a given clestroom to be 
observed when there were not «t leait five Experimentals and/or Controla In that 
claeeroom.*^^ During the initial data collection eeation claeeroon obaervations 
were Intended to be made on 56 etudenta fron this pool. Since the data on these 
Unclassified students are not pertinent to the major concerns of this project i 
they were not analyted and are not included in this report. 

The identification of students for the Experin«nt«l and Control Pools and the 
ultimate selection of specific students to be observed were perfomed by HumRRO 
personnel. Identities of the specific students to be observed were not known to 
the Dothan City Schools' administrative personnel or to the classroom teacher In 
whose room the observations were made. Observers were furnished the names of the 
students they were to obeerve, but they did not know which were Experimental* 
Control » and Unclassified students. 

One of the principal indicee used in thle evaluation is the data obtained from 
observations of student classroom behavior by the specially trained observers. There 
were some practical constraints on the number of students who could be observed and,, 
hence, on the number that could be used in the analysis. The number of trained 
observers was the basic determining factor. At the beginning of the school year 18 
observers participated in collecting the initial (pre-test) data during the first 
week of classroom observations. Nine of the 18 obeervere made additional pre-teet 
classroom observations during a second week (the following week) of observatione . 
This made an effective obeerver population of 27. Since a given observer could 
collect data on only 20 students per week, the total possible ssnple was 540 



^ The observation schedule called for observations to be made on five students 
in each claeeroom in which the special observers gathered data. 
The Unclaasified students were ob (Served merely to fill out their observation 
schedules. 
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• tudtntt. Th« plAnned d4t« collectiott »ch#=c**l# fcr tr;t i*:lcia1 'pr**t€st) data 
collection period and the nuabtrt of ttui«it4i actwuly cbatrvtd are 3ihcvr* in 
Table 2. Alao shown are the nvmbtra of *t\>4i2it* oi^ervtc In the laat (post- teat) 
data collection period. It is this latter gro^^ cf I3o Exp^riJMncala and 142 
Controls on whom the bulk of the analytei reporter tare vera tsade. The decrease 
in Ns frpiij pre- to post-obsexn/atlons 1$ eve tc a^seccei or scvaa of students 
or to observer absence during the second data collactict: period. 

Numbers of Students Observed IX;rxn.s Fre-Iest ^Koi rost-teat 
Observation Periodc by Studedt Category 

Fre^Test Target ?re-r*at Ctstrvtd Fost-Xest Observed 
Sample Sag? It Sample 

Experimental 



Students 


296 




236 


Control 
Students 


188 


:'6 




Unclassified 

Students 


56 


r*ot re^K!?rte'C 


r.ot reported 


TOTAL 


540 




378 





Table 3 depicts Che distributior^ by school ^d grsde of the ^50 students 
observed by the 18 observers during the pre-teat cata ccllecti<«:. Similar informa- 
tlon on th ^ post-^test data collection is g:.%'e::i in tne iUavlts chapter* 

EVALUATION INSTRUMENTS 

A number of product variables vere eacaainec as a ':aa:.* fcr evaluating the 
results of the project ♦ The evalustion ::nstr%»enta ^tilixad can be classified as: 
(I) tests treating cognitive factors; (Z) tests treating affectlva factors; and 
(3) behavioral observations. 
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TOTALS 


49 


29 


65 




55 


1 



3 



3 



55 



ERIC 



The nine obaervers who observed for two weeks are indicated by the letters :;sllovii;g 
the school naae. For exa»ple, the ease observer (a) observed at both Cloversalt aad 
Selma Street schools. 
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; tsasm.M, :a>^«rver a' observed at both Cloverdale «id 
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Cognitive 

Staadardizftd tchievtment twtt wtr« tht principal means of atsusin^ the 
accomplishment of educetionel objectives. The original design called for adainis- 
cration of the Metropolitan Achievement Test (MAT) at the end of each acadeiaic year. 
Results from the previous year served as pre- test data, while the results from the 
current year served as post- test data for that year. This was the manner in which 
achievement data were collected during the first year of the project. However, due 
to an administrative decision of the Dothan City Schools beyond the control of the 
Project Director this practice was changed during the second year of the project 
(1972-73). Achievement test administration was moved to the beginning of the 
school year. Therefore, post-test achievement data for the second year were not 
available until the third year, and post-test data for this, the third, year of 
the project will not be available until September or October of 1974, after this 
report is prepared. In addition, it should be noted that the Metropolitan 
Achievement Test was used for both pre- and post-test measures the first year of 
the project, whereas the California Achievement Test was used thereafter. 

Aiiective 

The original design called for two affective measures, the Pophaa Self Appraisal 
Inventory and the semantic differential Pupil Rating Form. These instruments were 
Intended primarily as tools u be used in the identification of student Experimental 
ana Control Pools. They could, of course, be used in a pre-post comparison. However, 
cue CO Che change from the Popham scale to the SOS scale, as previously mentioned, 
and the lack of need to identify student pools for the 1974-75 school year, due to 
the project's planned termination, no post-test scores on these two measures are 
available to evaluate affective outcomes during the third of the project. 




Behavioral 

A« previously noted, the prlnclpel outcome date were observations of actual 
•tudent behavior In the clasarooas of the aamples of BR and OX teachers. The 
following paragraphs describe in detail the manner in which these data were 
gathered* 

Observer Training. Eighteen women were selected by Dothan City Schools 
personnel for observer training in a HumRRO conducted workshop. On September 
20-21, 1973, a one and one-half day workshop on the observation and recording ' 
classroom behavior was held at Girard Elementary School, HumRRO personnel respon- 
sible for the workshop explained the purposes of the overall project and of the 
observer training program. Attendees were told that their training was intended 
to prepare them to observe and record, accurately and reliably, certain behaviors 
of selected pupils. Also, all 18 women had been classroom observers in the first 
two years of the project, so this trminlng was in the nature of a review for them. 

After the initial meeting, the trainee group was divided into smaller groups. 
Materials used in training included (1) handouts describing categories of student 
behavior to be observed, (2) data record forms, (3) stopwatches, (4) clipboards, 
(5) pencils, and (6) practice data collection schedules. A total of five hours 
of classroom training was administered over the one and one-half days. In 
addition, seven hours were spent in practice observation and data collection In 
actual classrooms. 

During the first morning of the workshop, the various categories of student 
behavior were explained and discussed. These behaviors are described in Appendix B. 
The necessity for objective observation and recording was stressed. Initial 
practice sessions of observing and recording "student behavior" (with HumRRO 
personnel acting as "students") revealed little variation in trainees' practice 
data. Discussion of the variance that Sli exist increased trainees' appreciation 
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ot Che loporcance of their own attending behavior, physical points of view 
(e.g., sitting where the students could be most efficiently observed), familiarity 
with categories of student behaviors, etc. Subsequent practice sessions reduced 
data variance even more. 

The necessity for observer confidentiality regarding the data collection 
process was eophaslzed. This was required to prevent, to the extent possible, 
changes in student and teacher behavior as a function of their knowing which 
students had been selected for observation. The importance of avoiding observer 
bias and th« need for objective and unemotional collection of data were also 
discussed. These latter points were pertinent due to the possible acquaintance of 
some of the observers with students and teachers in the classrooms to which they 
were assigned for data collection. Observers were instructed on how to assume 
minimally noticeable roles in the classroom and how to minimixe social interaction 
with students and teachers during data collection. 

The observers were assigned to schools by HumRRO personnel primarily on the 
basis of their knowing and being known by the fewest students and teachers at those 
schools. 

Data Collection Procedure . Five students and an alternate were selected for 
observation In each of the classrooms in which observations were to be made. As 
many Experimental students as possible were utilized so as to maximize the number 
of conflict students observed. To the extent that there were fewer than five 
Experlmentals in a given classroom. Controls were utilized, and in the event there 
were not at least five students from these two pools in a classroom, names were 
chosen randomly from among the Unclassified students in that classroom to provide 
the required five students to be observed. On each Data Record Form, the name of 
a sixth student, or alternate, was added, in the event one of the five intended 
for observation was unavailable on the first observation day. If the alternate was 
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•ubatltuttd for thU r«««on, ht wm «1«o observed on eubeequent occaeion* in lieu 
of the oritiixally ipecified student. Sanples of the individual end sunaaefy D«t« 
Record Forme ere ehown in Appendix C. 

The etudy design celled for each of 18 observers to be assigned five students 
in each of four classroons for each week of the observation period, or a total of 
20 etudents per observer per week. Since there were, effectively, 27 observers, 
this allowed a total of 540 students on whom data potentially would be collected. 
As previously noted, the distribution of students selected for the two pools, 
absences, and other factors reduced the number of Experimental and Control students 
on whom pre-test observations were actually made to 450. 

Two sets of observational data are analyzed in this report. The first was 
collected in September, 1973, and the second in April, 1974. A short refresher 
training period was given the observers prior to the second observation period. 

Each observer collected data on the same students on both the pre- and post- 
test occasions. As described in the Results section, however, some data were lost 
on the post-test due to various kinds of schedule interference or absence of 
students or observers, thereby reducing the number of students observed post-test 
to 378. 

Data were collected on five consecutive school days during each of the data 
collection periods. Six samples of student behavior per class period w'^re recorded, 
resulting in a total of 30 possible observations per student over each of the five- 
day data collection periods. 

Data were collected in the following manner. Observers entered their assigned 
classrooms at the beginning of the regular periods. The first 20 minutes were spent 
in an accommodation phase during which it was intended that the students, teacher, 
and observer would get Accustomed to each other. The observer also used this time 
to locate the subject e- V? ts to be observed. About 30 minutes were then spent in 
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observing ch« fiv« aubjtcc tcudents, on* after the other, in a eerlee of six 
obeervatlonel eequencee for eech itudent. Approximately one minute vas spent on 
each observation, aa followa. The observer visually Identified the appropriate 
student, started the stopwatch, and closely watched the student's behavior for a 
timed 45 seconds. The observer then Immediately recorded the occurrence or non- 
occurrence of each of the nlne^^ behavior categories listed by that atudent'a name 
on the Data Record Form, a process that ustially took about 15 seconds. After 
recording the data, the observer looked up, identified the next student to be 
observed, and began the cycle again. After all five aaslgned students had been 
observed once, the observer repeated the sequence of observatlona five more times. 
In this manner each student was observed for 45 seconds on each of six occasions 
at flve-mlnute Intervals during one class period per day for five consecutive days 



Eight of the categories were types of inappropriate behavior j the ninth 
category was "appropriate." 



V. RESULTS 



In presencing the r«aulcs» emphasis will be placed on the results of the 
project's third year of operation. However, frequent reference will also be made 
to results of the first two years of the project as well. 

The reader will recall the earlier comments concerTiing the procedure whereby 
the teacher and student populations were sampled. Five teacher groups (BRl, BR2, 
BR3, 0T4, and 0T5) provide one dimension for the analyses, while the tW9 student 
groups (Experlmentals and Controls) provide the other. The data examined are pre- 
and post- test measures of performance or behavior of the two student groupings. 

Figure 1 in the preceding chapter depicts the distribution of the teacher 
population into the various groups and shows the numbers of teachers in each group 
in whose classrooms observational data were gathered. Table 2 set forth the 
numbers of students on whom observational data were gathered on both the pre-test 
and the post- test. It will be recalled that 236, or 861, of the 274 Experimental 
students observed on the pre-test were also observed on the post-test, while 142, 
or 81Z,of the 176 Control students originally observed were observed on the post- 
test. As previously noted, the reduction in Ns from pre- to post-test was due to 
student absences or moves and observer absence. Previous analyses indicate that 
the losses are generally random in nature and that the post-test samples are 
representative of the pre-test groups. The analyses reported here are based on 
the 376 students (i.e., 236 Experlmentals and 142 Controls) on whom both pre- and 
post- test observational data were collected. Table 4 gives the numbers of 
Experimental and Control students in this post-test sample for the various teacher 
groups. It will be noted that the Ns are generally adequate for most groups, the 
possible exceptions being the BRl Control students (N*14), the 0T4 Controls (N»23), 
and the 0T5 Controls (N"20). It will be remembered that the total number of 
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studentB who could have been obeerved was conitrained by administrative and fiscal 
considerations and that the BRl and 0X5 teacher subgroups were small to begin with. 

2'dbU 4 

Numbers of Students with Both Pre- and Post Data 
by Type and Teacher Group 

TEACHER GROUP 
BRl BR2 BR3 OTA 0T5 

STUDENT TYPE (12 T chrs.) (28 Tchrs.) (27 Tchrs.) (18 Tchrs.) (13 Tchrs.) TOTAL 

Experimentals 36 62 51 57 30 236 

Controls 14 ^38 47 23 20 11^2 

TOTAL 50 100 98 80 50 378 



COGNITIVE OUTCOMES 

Student academic achievement was the area of principal cognitive concern. 
As was noted in the design chapter, the change in achievement testing schedule for 
the Do than City Schools has resulted in the standardized achievement test scores not 
being available for usd as post-test indices at the end of an academic year. Con- 
sequently, the post-test data on academic achievement for the third year of the 
project are not available as of this writing. Data are presented for the second 
year. 

During the first year of the project there was a slight, but not statisti- 
cally significant, advantage shown in achievement gain by the students of the OT 
teacher group. Also, while one might logically have expected Control students to 
show greater gains than did Experimental students, the first year data did not 
bear this out. In essence, the gains in student achievement during the first year 
of the project did not show any systematic relationship to student or teacher 
variables used in this study. 




Only rtadlng Achl«vtn«nc ttsc scorM are avallabl* for consldtratlon in this 
report. In rtvi«wlng thtaa daca» cht reader should keep In mind that they pertain 
to the eeoond year project reeulta, i.e., the 1972-73 school year. Also, it should 
be kept in mind that the Metropolitan Achievement Test was used for the pre-^test, 
whereas the California Achievement Test was used for the post-test. The numbers of 
students represented in the achievement data for the second year are somewhat less 
than the numbers in the second year post- test observation sample due to incomplete 
or missing data for some of the students.-^ Table 5 presents the reading achieve- 
ment data for the project's second year. The pre-test data were gathered at the 
end of the 1971-72 school year, while the post-test data were gathered at the 
beginning of the 1973-74 school year. Thus, the changes in achievement cover an 
elapsed time period of approximately 16 months, including the 1973 summer vacation. 
For reference purposes. Table 5 also shows tha original 1972-73 post-test sample 
sixes for each of the teacher-student groupings. 



Table 6 

Pre-Post Reading Achievement Grade-tevel Gain 
by Teacher-Student Groups (Second Year Results) 



Building Representatives Other Teachers 

Exptrimentals Controls Experimenf Is Controls 

M 0.5 1.2 0.6 1.3 

0 l.l 1.3 1.1 1.4 

N 46 58 60 84 



Post-test 

Sample N 87 90 109 116 



1/ 

In view of the numbers of students for whom no data were provided, inquiry was 
made of the project staff on this matter. Achievement testing occurred as part of the 
annual system-wide testing and was external to this project. Inadvertently, an 
Incorrect level test form was used for fifth- and sixth-grade students, thereby making 
their test results invalid. Hence, a substantial number of students had no valid post- 
test achievement scores. 



A» can be seen from Table 5, there !• no significant difference in achieve- 
ment gam between students of BR teachers and those of OT teachers. On the other 
hand, the difference between Experimental and Control students is significant for 
both the BR and OT groups (t«2.47 for BR, and t-3.13 for OT). 

On the basis of this sampling of student achievement it could be concluded 
that the special in-service training given during the project's second year did 
not seem to affect reading achievement of students of the teachers who received 
that training. This result would be consonant with the first-year results on 
achievement. Of course, there have been individual anecdotes of dramatic gains in 
achievement by students of both teacher groups, but no systematic group differences 
between BR and OT teachers were shown. 

The finding of a significant difference between Experimental and Control 
students is expected. It seems reasonable that students identified as suffering 
significant emotional conflict problems would show a lesser achievement gain than 
their Control peers whose behavior is at the opposite end of the continuum. It 
does suggest chat more emphasis is needed on teaching techniques for conflict 
students. It. should be noted that, while the third year of the project placed 
greater emphasis on teaching techniques, evaluation of its results cannot be made 
in this report because of the absence of any third year post-test achievement data. 

The reader is cautioned to view the achievement data presented here with 
some reservations. First, it is a limited sampling of academic subject matter. 
Second, the Ns on which the data are based are only 50% - 70% the size of the 
original second year post-test Ns due to missing data. The representativeness of 
these sub-samples is unknown. Finally, the effect of changing from the Metropolitan 
Aptitude Test (pre-test) to the California Achievement Test (post-test) on these 
data is unknown. 




AFFBCnVE OUTCOMES 

Th« principal «rt« of affective concern ttated for the Comprehenelve Services 
project wee student self-concept. The Pophea Self Appraisal Inventory was to be 
the basic laeasure of this fsctor» but as vrss previously noted, the Self Observstlon 
Survey (SOS) was substituted for administrative ressons. Since no post-test SOS 
scores were gathered at the end of the project's third year, and because of the 
dlfferenceii between the Popham and SOS Instruments, nothing can be said concerning 
self-concept changes over the second and third years of the project. The first 
year data on the affective measures gave some suggestion of greater change in self- 
concept, in the direction of an Improvei self-concept, for the Experimental students 
who were In the BR classrooms than for those In OT classrooms. Unfortunately, there 
is no means to assess whether this trend carried over Into the second end third 
years of the project. 

BEHAVIORAL OUTCOMES 

As ststed, the principal concern of the Comprehensive Services project was 
student living skills, and the primary data were observations of classroom behavior 
by Independent observers. The behavioral observations focused on Inspproprlste be- 
haviors since one of the primary problems of children with conflict problems Is the 
relatively higher frequency with which they exhibit behavior that is Inappropriate 
for a given occasion. In the clsssroom, to the extent that the child's behavior is 
inappropriate, it interferes with his learning and adjustment as well as that of his 
peers. It is for this reason that the Comprehensive Services progrsm has focused on 
student classroom behavior and the teacher's clsssroom management skills as being of 
primary concern. 

Data Forms Scoring 

Separate scores were derived for each student for the observational data 



collected during the prt- And po«t-t«»t data colUctlon •«:»sionti. Theae scores 
were « function of Che cotel number of ineppropriate behavior categories a student 
was obterved co exhibit during an observation period and the number of times he 
was observed. The maximum number of observation periods posalble on a given student 
was six per day, or a total of 50 within the five-day observation session. However, 
due to abBentwelsm and classroom interruptions » not all students were observed the 
maximum number of times. 

A single score was obtained by summing the inappropriate behavior tally marks 
on the Observer Data Form (see Appendix C) and dividing by the total number of 
observe t Ion periods for which there were data. A tally mark represented the fact 
that a given category or type of inappropriate behavior had occurred during that 
obaervstion period and not the frequency with which it occurred. That is, only one 
tally would be made for that category regardless of whether the behavior oc'-urred 
once during the observation period or more than once. Therefore, the quotient from 
the abova division Is the mean nijrober of inappropriate behavior categories a given 
student exhibited during an observation session. These derived scores were used in 
the statistical calculations reported in this 8ection.~^ 

Observation Results 

The classroom observations were the principal data used in the evaluation. 
In Table 6 the mean number of inappropriate behavior categories observed is given 



— Reference to the Observer Data Form in-Appendlx C shows that there were eight 
different caitegurles of inappropriate behavior that could be reported. Thus, the 
maximum number of tallies that could be recorded for a single 45-second observation 

period was eight, regardless of the number of times any one of the behaviors occurrec 
during the 45 seconds. Since there were eight different categorlts of inapt- r. prist J 
behavior and the maximum number of tiroes a student could be observ*^i ' .i6 30, his 
maximum mean score would be 240 i 30, or 8.00. In much of the dUr-..-^ irr ^ ^ this 
report the mesn number of inappropriate behavior categoriei* obsef^^j 'eferreci 
to frequenay of inappropriate behavior. The reader is cautioned ic ket^ mind 
how this "frequency" score Is derived. 
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for th« total BR and OT group* by ttudeat typ*. 7tw a*4£* *r« i>«»«4 on th« 
po»ft««t •«aplt Nt flvtn in T«bXt 2. 



Mtan Nuabtr of IntppreprlAtt l«h«\ior Cttt|i3ri«s 



Student! Frt Pott Prt ?ett 

Exp«rla«ntal« O.Sf CfS 1.03 1,06 

Controlt 0.&6 C,?^ 0,Ti 0.83 

Th» data Irv Tablt 6 »hov tht ExperliMKit*^ fti*dtst» to have f igalficaotly 
higher ntans than the Control* in all is#ti3ic«#. Is coa^arisig Experiiaeix t«X and 
Control ttudenti, t*2»30 for th» pre-tMt; t»*.feC for ti:* 3X ?o«t-c««c; 
t-4.24 for the OT pre-test; txtd t-2.T: for the CC ?c«t-t«4t. Each of theee 
indicate* differences elgniflcatit beyoad the 55 level of cociideace. Thie 
indicate* th«t the procedure! vhereby ttudest* vere clajalfled a* Experimental* 
or Control did result in eigtvif icantly ciff*res.c grc*^* oz. the pre-test be- 
havioral aeaeures. The student seltcticrs ?rcc«si-»;r« prctcuce* behavioral result* 
that are compatible with that which would be prefdicte* is a co«parl«otx of 
students twinifesting emotional conflict probleas acd thoae vatiiout such problem*. 

It is of soxD* interest to note the coc*i»ter;cy of the student selection 
process and the results it producea is tenu of the behavioral pre-test data ov^jr 
the three years of the project. Table 7 preses^t* aean fre^u«:ic?i^ of inappropriate 
behavior for the pre-test observ*tions over the three yaer* of the project. 
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" The 5X level will be used a* the level ladicatisg statistical significance 
throughout this report. 

" See footnote, page 41. 



M««n Ptft^utncy of Iti«.ppropri*tt i*h«vicr by 
Studtnt-Tttchtr Ctttgory by Yt«r (?rt-tMt ocly) 

Building Cthmr 

Y(Mir t3q>T « Control Ix^^r , Cgstrol 

1. 1971-72 1.20 l.i: C.$t 

2. 1972-73 lai 0.5? 1.05 0.91 

3. 1973-74 0.99 0.16 1.03 0.73 

Af c«n bt ••«n froa X»bl« ?» tht telectiOG proc*«« h** givta hlfiily r«procucii: 1* 
r««uXti In tiroui of producing group* of ScptriffitstAl mad Cotitrol «^gd«iit« whc aiffer 
•Igniflcantly from on« anothtr on th* pr»-tMt dAt«. ThU U daslred. P'urtb*r, 
the trapXlng proctdurit produced eixsples of £xptri.s«nt«l scudex^ct chAC die ^ot clffcr 
•Ignlf Icently bttwten the two beeic teecher growpiagi in «ny of th« tiire* ye*r*. Ix: 
othe«r words t At the beginning of eech yetr, (i.e., on the pre-te*t^ Sxperiaent** 
•tudente in the rooiM of BR teechere exhibited Ineppropriete behavior vith * frequeasy 
thet wes not eignif icently different fro® thet exhibited by Sacptris^eziel stjcezt* is 
the roooui of OT teechere. The teae wee true for Control* for the firet two ye*r*. 
However, during the third yeer the OT Control etudente eaiiibited e «lgnifit4fcr:tXy 
lower frequency of ineppropriete behevior (t»Z,03) then did the BX ContrcU on tne 
pre-teet. Overell, theee reeulte indicete thet the student selection ati ees^Ilng 
proceduree ere eetiefectcry . The coneietency of the beheviorel dete over the tr.ree 
yeere eleo tupporte the contention thet the observer progrcs produced relleble enc 
velid dec*. 

It ie of soae interest to note the steedy decrease In pre-test aeens for the 
Experimental etudentt over tht three years of the project. During the flret y*er. 
the pre- test meene for Experiaentel students were 1.20 end 1.11 for the BR cnc 
groups, respectively. The eecond yeer these velues dropped to 1.11 ens 
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r*c jr^yt^t*. Thi* result *u|SMt* itvtr«I tnttrestitif, hTJ>ct^*t4liJl. Pcmap^ th« ona 

;.a'*««rvic* trAialn^^ includtag the costiri.gt^cy a«3:*itaeiLt tec^dqu^ii , 
:ci*r4:i::g ever t.n« thr«« ymur* of the proitct* As sicrt sere c: tht elea^ntary 
i:noc*-<tAcn«r« n-Av« rtecieiv#4 this tr^lalng, it* effect* vc**;Ic reAch ^re czc iiore 
^-.;.^^r*i: *a tnit system vnth the coatequer^ce that the t:usier5 c: ft'^er^ts cevijitxag 

t.-:** acra c: LOAppropriAte b»eh*vior^ xxght be reduced, Azi that the Ascunt of 
i^ci a«vtAt;.c?ii ¥t:'ulc be reduced* With reference tc this lAJSt ?oitit cct;cerr*i:af 
4SBic\ix:z 3: aevxAtioa froa the norra, it i« of interest tc ricte thet the grcup VAria-^ 
2:.l^r' tne pre-tejit obstrvsticr* detA decrr*.Ased esch year fcr t::e Exp^rises^tal 
$r^c*x:t:». StanCAra ceviatlor^s for the BR group vere C.^", Z.t^, asc 3.5C for 
'^lAT:! ^ce through three,, vhiie for the CT group the ccs^ATAile figures were 0.55, 
* Asta ^ 5C, respectively. 

The dSASse :j:.tuA' icu of reducing saat;^ ahc stAndAxd ceviAtiocs ever the three 
'stiAT^ jenerAllv abCAlned for the Control students as veil* Eeferecce tc tshle 7 
re-j'^wu^ tnAt t.ie oaly exception was the rise in SiAAn fcr the Controls from 0.95 
Z2 : rr^m tne first tc the second yeAr* Thus* the c;is:ulAtive prcgrAS effect is 
«''ixent :cr ncn-^confllct students as well as for these TSAr.l. res ting i:^ces of 
^^cUct. This finaing is of considersble i^jportence in thAt it suggests thAt the 
irj^raa wAd^ of benefit to All students^ not just those n-Anifesting conflict behAvior 

a^a A^temAtive hypothesis was AdvAnced m the seconc yeAr's evsluAtion report 
zz t.'te errect thAt the pre-'Cest drop in aeen for the IS Ixp^rlaentAls froa the first 
reiiC- :c :ne «econc sight be due to the SR teechers hAving plAced their contingency 
aAn^i«©ent progrAsw m operation before the pre^test dsts ccllecticn fcr the second 
j««Ar VA^ Accossplished- This vas possible becAuse o: the scheduling cf the pre-test 
i^itA :;::llection curing the 19"^2-73 schocl yesr (:tid-Cctcber . However, this 



«xpi4aACion »eea« le«« likely m view of the continued drop In pre-te«t se4R* 
durin^i the third year. The 1973-7'«» pre-test dete collection occurred in 
5«pt«aber, *nd the contingency menegement m-semce training wae organised to 
prevent contingency contract program* from being initiated prior to the pre-. est 
data collection. All thing* conaxdered, the cumulative effects hypotheais aeem* 
the likelier of the two in explaining the reaulta over the program's three years. 

During the second year's report it was noted that those BR teacher* who were 
m Che original first year group seemed to produce greater decreases in inappropriate 
stwient behavior than did those who were in the BR group only for the project's second 
year. M will be recalled from Figure 1, during the third year 22 of the 26 first- 
year BR teachers were still in the system, as were 49 of the 52 second-year BR 
teachers. In order to assess the continuing effects of their In-service training 
over time, student* from the classrooms of some of these teachers were Incliided in 
Che third-year observation data. Specifically, 12 of the 22 flrst-yemr BR teachers 
were included, as were 28 of the 49 second-year BRs- In addition, 27 of the 53 
third-year BRs who received the full in-service program were included. Behavioral 
data :or these three BR groups and for the two OT groups are given In Table 8. 

As can be seen m Table 8, the BRl group continued their effective classroom 
aanageaant performance. ;h their Experimental and Control atudent* showed a 
reduction in inappropriate behavior from pre- to po*t-te»t. Due to the small S», 
these differences are not statistically significant (t-l.l5 for BRl Experlmentals; 
t-1 83 tor BRl Controls) Considered with their first- and second-year data, the 
performance trend for this group of teachers is impressive. Their pre- and post- 
test means for Experimental students during the first, second, and third years, 
respectively, were: 1 20 and 0 90; i,02 and 0.90; and 1.09 and 0.95. In each year 
they effected a reduction in inappropriate behavior over the course of the year for 
their Experimental students Over the total three-year period, the BRl Experimental 
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TabU 6 

Frequency of InappropriAte Behavior by Teacher 
and Student Croup (Pre- and Post-Test)*' 



Teacher 

Group 



Experimentals 
Pre Post 



Controls 



Pre Post 



fiRl 
(1971-72) 



M 

0 



1 09 



0 57 



36 



0.95 



0.A3 



36 



lai 0.89 



0.3i 0.32 



14 



BR2 

(19 72-73) 



N 

0 

N 



0.86 0.90 0.84 0.74 

0 40 0.42 0.33 0.37 

62 62 38 38 



BR3 

(1973-74) 



M 

c 
N 



1 06 



0.54 



51 



L 13 



0.66 



51 



0.80 0.74 



0.36 0.32 
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47 



(1973-74) 



M 

0 

N 



1 07 
0.54 
57 



1.10 
0.58 
57 



0.68 0.92 
0.30 0.39 



23 



23 



0T5 
(1973-74) 



0.96 



0,43 



30 



0.97 



0^42 



30 



0.78 0.72 



0,39 0.43 



20 



20 



All data are for the 1973-74 school year. 
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combined pre-tesc mean w«» 1.12, and the poat-iest mean wa« 0.92. Over the same 
three-year period the pre- and post-test means for BRl Control students were 
0 91 and 0 87, respectively 

In contrast with the performance of the BRl group, the BR2 group over the 
two years in which they have functioned exhibit a somewhat different picture. The 
pre- and post- test means for their Experimental students for the two years combined 
are 1,00 and l.Ol, respectively. Thus, their Experimental students exhibited no 
change in frequency of inappropriate behavior over the two-year period. Reference 
to Table 8 shows that the BR3 Experimental students also exhibited an Increase In 
frequency of inappropriate behavior during the one year (1973-74) represented, though 
this increase is not statistically significant (t-0,58). However, the BR2 Control 
students showed a pre- to poat-test decrease in inappropriate behavior for the two 
years combined (Pre M « 0.98; Post M • 0,90), as did the BR3 Controls (See Table 8). 

It is realized that combining data over the three years of the project may be 
questioned, and the reader should be cautious in interpreting, but whether one views 
the BRl teacher group's performance separately for the individual years, or In 
combination, it appears that these teachers are producing consistent results with 
their students. Whether this is due to selection factors related to being the first 
volunteers for an innovative program, to something unique in the in-service training 
given thiti first BR group, or simply to the cumulative effects of their experience In 
using the techniques taught in their in-service training Is unknown. Regardless, 
this ciPDup has performed well. 

In Older that the reader can see the full results of the project's three years 
of operation, the data for all BR and OT groups have been combined for the three 
years. The resulting means and standard deviations are shown in Table 9. It can 
be 6een that, in spite of the variation in performance of the BRl, BR2, and BR3 
groups over the three years, combined they show an overall reduction from pre- :c 



poiC-^tMC fM«n» for both th«lr Exptrlmtntal students (K06 to 0.99) and for their 
Control students (0«92 to 0»86)« The reduction for Experimentels is statistically 
significant (t«2,29)» while that for Controls almost reaches the 5% level (t»K92). 
In contrast! the combined OT groups show a slight » though not statistically 
significant ! increase in mean from pre* to post-test (U06 to 1«08). Tl»e Control 
students of the combined OT groups show a pre* to post- test mean reduction that 
is not statistically significant (t"l«72)| a finding comparable to that for the 
BR group. 

Table 9 

Pre- Test and Post-Test Means » Standard Deviations » 
and Ns for Combined Three-Year Data by Teacher-Student Group 

Buildina Representatives Other Teachers 

Experimental Control Experimental Control 





Pre 


Post 


Pre 


Poet 


Pre 


Poet' 


Pre 


Poet 


M 


1.06 


0.99 


0.92 


0.66 


1.06 


1.08 


0.89 


0.84 


0 


0.56 


0.56 


0.39 


0.39 


0.51 


0.62 


0.41 


0.44 


N 


287 


287 


219 


219 


305 


305 


228 


228 



In comparing these three-year results for the BR and OT groups it should be 
noted that there were no differences in students assigned to the two teacher groups » 
i e.| for a given student type» in terms of their pre-test scores. The BR teachers 
did achieve a significant reduction in inappropriate behavior for their Experimental 
students » whereas the OT Experimentals showed a slight increase. Both teacher groups 
effected some reduction with their Control students. It appears, then, that the 
special in-service training did better prepare the BR teachers for dealing with the 
inappropriate behaviors of their Experimental students than did teachers without such 
training. However, the reader is again cautioned in interpreting these combined- 
year data, though their 
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meaning appears fa^J^y straightforward. 



Th« 1973-74 behavioral obatrvation data can be axamj.n«d in a ioat^ri^at sia^ier 
format I I.e., aimply in terma of tha nuobara of studanta in the various groups who 
showed an Incraaae In Inappropriate behavior over the course of the year and tne 
number who ehowed a deereaae. Of course . one would expect the results of such an 
examination to be generally conaonant with the data already presented, the behavior 
change analysis, however, does give some idea of what happened to individual 
students. 

Table 10 presents frequency data for the various teacher-student groupings. 
Students who showed an Increaae in inappropriate behavior over the year, i.e., 
their post-test score was greater than their pre-test score, are shown in the 
column labeled *'increaae," whereas those who showed a decrease over the year are 
tabulated under the col\um labeled "decrease." In general, the total Ns shown for 
any teacher-student grouping will agree with those shown In Table 2. Such dis- 
crepancies in Ns as exist are due to the small numbers of students whose pre- and 
post-test scores were equal. A number of Chl-square analyses of these freqxiency 
data were performed and are discussed below. 

As can be seen from Table 10, the Experimental student groups showed relatively 
little change over the year for the various teacher groupings. The differences saong 
the varioua teacher groups were not significant in terms of behavior change of 
Experimental studenta. For tha Control group atudenta, however, there were some 
significant differences. All BR teachers combined differed significantly 
(x'^ - 4,54; p < .05) from all OT teachera combined for their Control students. If 
the numbers In Table 10 are summed over these groupings for Control students, it 
can be seen that for the BR teachera 61 students (i.e., 10 + 26 + 25) showed a 
decrease in inappropriate behavior, while only 35 showed an Increase. For the 01 
group Controls, only 18 showed a decrease, while 23 exhibited an Increase. 



Tabl0 20 

Direction of Change In Inappropriate Behavior 
(Pre- to Post-Tea t) by Teacher- Student Grouping^' 







Direction 


of Change 




Teacher Group 


Student Group 


Increaae 


Decrease 


Total N 


IRl 


Experimental 


17 


19 


36 




Control 


4 


10 


14 


BR2 


Experimental 


31 


31 


62 




Control 


11 


26 


37 


BR3 


Experimental 


27 


23 


50 




Control 


20 


25 


45 


OTA 


Experimental 


31 


26 


57 




Control 


16 


6 


22 


0T5 


Experimental 


13 


17 


30 




Control 


7 


12 


19 


•"^Data are 1973 


-74 observations. 








Also of interest is 


that the 0T5 group 


(no in-service training) showed 


a slgnif- 



Icantly better performance with their Control students than did the 0X4 group 
(partial in-service training). In that comparison, 16 0X4 students showed Increases 
and 6 shcw«d decreases, while the 0X5 group showed only 7 Increases and 12 decreases 
(x^ * 5.33; p < .01). Within teacher groupings, the only significant difference was 
between Experimentals (75-^ and 73-) and Controls (35+ and 61-) for all BRs combined. 
Thus, these analyses show no real differences between BR and OT groups with reference 
CO their Experimental students, but some significant differences with respect to 
their Control students. BR teachers as a group obtained better results with Control 
students than did 01 teachers as a group, and 0X5 teachers obtained better results 
with their Control students that did 0X4 teachers. 



In suanuLry of thftte anAlyttt of dlrifCtlon of behavior change, the results ere 
little different from those shown in Table 8. To put the Table 10 data in context, 
the reader should also consider the level of pre-test inappropriate behavior of the 
various groups as set forth in Table 8. For example, by chance, the BRl group 
actually had Control students with the highest pre-teat mean of any subgroup, 
Experimental or Control. Thus, it is understandable that the BRl teachers may 
have devoted uore attention to these Control students (and, hence, have accomplished 
a considerable reduction in their inappropriate behavior) than would nonoally be 
expected for Control students. Similarly, the superiority of the 0T5 teachers over 
the OTA group may be related to the relatively lower pre-test standing (i.e., less 
Inappropriate behavior) of their Experimental students. Theirs was the only 
Experimental group with a pre-test mean less than 1.00. Thus, their Experimental 
students may have required less of their attention than did those of the other 
groups . 

Pre-Post Correlation 

In the first two years of the project the pre-test and post-test observational 
data showed moderately high correlations with one another. Table 11 shows the 
correlation of pre-test and post-test observations by student- teacher grouping for 
each of the three years of the project. As can be seen, most of the correlations 
were In the .40 to .60 range. All correlations were positive, indicating that those 
students who scored high on the pre-test tended to be high on the post-test, and 
the low pre-test scorers tended to be low on the post-test. All correlations were 
statistically significant. 

In the first year's correlational data there was some suggestion that the 
BR teachers may have shown greater differential selectivity in applying their efforts 
to the modification of their students' behavior to a greater degree than did the 
OT teachers. Thus, if they concentrated more heavily on modifying the behavior 
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Tabl0 n 

Correlation of Pre-T«»t and Post-Test Obseivations 
by Student-Teecher Group by Project Year 

Building Representatives Other Teachers 

Students I«*£j. Year 2 Year 3 Year I Year 2 Year 3 

Experimencais +.38 <*6 -♦■.60 +,68 + 64 -^.62 

Controls +.38 +59 +40 +.34 + 59 +66 

(and were successful in doing so) of their oore severe "problem children/' the 
correlation between pre- and post-test measures would be lower than if they con- 
centrated more evenly on all students or If their efforts to modify behavior were 
unsuccessful The three-year data do not strongly support this hypothesis, though, 
m general, the correlations for the BR group are lower than those tor the OT group 

Analysis of Inappropriate Behavior Categories 

Correlational analysis was not pursued beyond pre-post correlations in the 
previous years' report because it la generally outside the principal concern of the 
evaluation However, a large number of mcercorrelatlons baaed on the 1973-74 
data are presented In Appendix D for the readers' inspection. A few comments on th* 
data are in order . 

The data in Appendix D are mtercorrelations among the various categories of 
inappropriate behavior which the classroom observers bad been trained to note. The 
eight categories of inappropriate behavior—^ are described in detail m Appendix B 
In addition to the Intercortelatlone of these behaviors and related factors, given 



1/ 

The eight categories are: (1) Gross Motor (GM); (2) Object Noise (ON); 
(3) Disturbance of Other's Property (D); (4) Contact (C); (5) Verbalization (V) ; 
(6) Turning Around (TA) ; (7) Mouthing Objects (MO); and (8) Other Inappropriate 
Behavior (OIB). 




•«p«rAt«Xy for pr«-c«at aad poat-t««c obttrvntlont and by th« four baalc taachtr- 
«tud«AC grouplngt, Apptndix D glvtt ak««nt and atanu.rd dcvlatlona for aach of tha 
bahAvlor cAtagorlaa. labia 12 praatnta tha maan numbara of bahavlora obaarvad in 
a«ch catagory for aach taachar-atudant grouping for both pra- and poat-taat 
obatrvationa. It should bt notad that thaaa data ara tha avar&ga numbara of total 
tlnaa that th9 varloua catagorlaa vara narkad for aach atudant ovar all obaarvatlon 
parloda. For axasoipla, In tha BRE (Building Rapraaantatlva Exparlnantal) group, tha 
Groaa Motor (GM) catagory vaa markad a total of 3.33 tlmaa» on tha avaraga» for 
aach atudant ovar tha antlra waak of pra-taat obaarvatlona. Sinca tha avaraga BRE 
atudant waa actually obaarvad on an avsraga of 28.31 aaparata occaalons^^ during 
that waak, ha axhibitad GH bahavior* on tha avaraga, 0.12 timaa par ona-minuta 
pariod of obaarvatlon (l.a. , 3.33 * 21.31). Whlla a nuobar of Intaraatlnt aapacta 
of thaaa data ara dlacuaaad in aubaaquant paragrapha, it la worth noting hara tha 
rathar high dagraa of conaiatancy of thaaa data ovar tha four taachar-atudant groupa 
and from pra-taat to poat-taat. Thla conaiatancy la ancouraging with rafaranca to 
tha quality of data providad by tha obaarvara. 

Aa can ba aaan from Tabla 12, tha dlffarant catagorlaa of bahavlor ara qulta 
dlffarantlally rapraaantad in tha ovarall "Inappropriata bahavlor" data dlacuaaad 
ao far in thia raport. For axanpla, for tha BRE group, in tha pra-taat data tha 
moat fraquantly no tad catagory (Othar Inappropriata Bahavlor; M • 6.09) waa notad 
ovar 25 tlaaa aa fraquantly aa tha laaat fraquantly notad catagory (Diaturbanca of 
Othar 'a Proparty; M • 0.23). Similar variation a'xiata in tha othar groupa for both 
pra> and poat'taat data. If tha varloua catagorlaa ara rank-ordarad for tha 
dlffarant groupa, it can ba aaan that tha ralatlva importanca of tha varloua bahavlor 



" Tha actual numbar of obaarvatlona par atudant worka out to ba alightly leaa 
than tha total of 30 that waa plannad dua to abaancaa and ralatad factora; aaa tha 
dlacuaalon on pagaa 34 and 35. 
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M««n Nuab«ri of Catagoritt of tnapproprlatft Bohavlor 
Oba«rv«(l by Toachftr-Studont Grouplnt for Pro-Toit and Poat^Taat 

Obtarvatlona (1973-74) 

Taachar-Studtnt Group 



lahavior 





CataAory 


BRE 


BRC 


PTE 


ore 




CM 


3.33 


2.71 


3.34 


2.51 




ON 


2.76 


1.94 


2.16 


1.23 




D 


0.23 


0.16 


0.36 


0.09 


Obaarvatlons 


C 


0.9X 


0.58 


0.72 


0.35 




V 


5.83 


5.26 


6.15 


4.42 




TA 


3.40 


2.74 


3.51 


1.86 




MO 


5.26 


6.72 


6.39 


5.74 




OIB 


6.09 


4.59 


5.98 


3.40 




GM 


3.14 


1.96 


2.38 


2.05 




ON 


2.55 


1.73 


2.38 


1.40 


Poac-TaaC 


P 


0.23 


0.10 


0.41 


0.12 


Obnarvaciont 


C 


0.69 


0.33 


0.62 


0.72 




V 


5.56 


5.12 


5.60 


4.98 




TA 


2.20 


2.14 


3.00 


1.81 




MO 


5.30 


5.62 


6,83 


6.44 




OIB 


6.53 


3.83 


6.69 


4.30 



cacagorlaa to ovaralX Inapproprlata bahavlor fraquancy la about cha aaaa for both 
acudant typas. Tha only major diffarancaa aaam to ba that tht OIB catagory is tha 
largatt ovarall contributor for all Eicparlaantal atudanta» wharaaa It la third for 
all Controls I and tha MO catagory nakaa tha graatast ovarall contribution to in- 
approprlata bahavlor aaong Controla* whlla it is aacond on tha llat for tha 
Exparlaantala. Thua> tha' s appaars to ba aoma qualitativa dlffaranca in tha typat 
of inappE-oprlata bahavlor shown by Exparlaantal and Control atudsnts in addition to 
tha quantltatlva diffarancaa pravioualy dlscussad. 

If tha pra-taat and poat-taat naans in labia 12 ara conparad, it can ba saan 
that BR taachars* atudanta axhlbltad raductions in Inapproprlata bahavlor from 
pra- to post-taat in 13 of tha 16 comparieons (l.a., aight catagorlaa aach for 
Exparlaantal and Control atudanta)* vhlla OT taachars' atudanta showad raductlona 




m only ttlx of th« 16 coBp«ri»on». The difference In the pre- and poet-test 
category meeni» ere shown in Teble 13. The minus signs denote reductions m In- 
appropriate behavior over the course of the year» whereas the plus signs denote 
Increases. Comparison of the frequencies of decrease and Increase over these 
categories shows that all BR teachers' students combined showed a significantly 
greater number of decreases from pre- to post-test (x^ - 6.35; p ' .01) than did 
all students of OT teachers 

TabU iS 

Difference In Fx e- Test and Post-Test 
Behavior Category Means by Teacher-Student 
Grouping and by Behavior Category^/ 

Teacher-Student Group 
Behavior Category BRE BRC PTE QTC 



GM 


-0.19 


-0.75 


-0.96 


-0.46 


ON 


-0.20 


-0.21 


+0.22 


+0.17 


D 


0.00 


-0.06 


+0.05 


+0.03 


C 


-0.22 


-0,25 


-0.10 


+0.37 


V 


-0-27 


-0.14 


-0.55 


+0.56 


TA 


-1.20 


-0 6C 


-0.51 


-0.05 


MO 


+0.04 


"1.10 


+0.44 


+0,70 


OIB 


+0.44 


-0.76 


+0.71 


+0.90 



^^Hlnui sign indicates decrease in value from pre-teac obaervatlon co 
poat-teat obaervatlon. All data are for 1973*74e 

The queotlon of the qualitative make-up of inappropriate atudent behavior can 
be examined from another perspective. Table 14 sets forth the correlations of 
student scores on each of the eight behavior categories with the total Inapproprlat 
behavior score Correlations are given separately for pre-test and post-test 
data for each teacher-student group. 



CorreiAtlon* of R*h*vior CAttf'^'^' Sccr*5 with toe*! 
In«ppropri«tt Behavior Sccre by ItAC>.tr-St«<«s5: vTou?, 
by behavior Category. by ?re- isc ?»#t-r*»c Score 



Behevlor 




BR£ 




PTE 




BEC 




ore 


Category 


Pre 


Poet 


Pre 




• * ^ 


?o<t 


Pre 


Poet 


CM 




+.59 


-.56 


♦.*.3 






-.08 


+.12 


ON 


♦ .64 


+.62 


-»-.64 


♦ .feC 


a «« « 


-.27 


-.56 


+.61 


D 


"f. 44 


+.41 


+.3S 


-.56 


« 


-.21 


-.15 


+.03 


C 


+.58 


+.63 




-.52 




-.39 


-.20 


+ .32 


V 


+.65 


+.69 


+.64 


-.72 
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In txMiining Tablt U the reaier ihould aote tz^t th^ first ti#o coluani group 
Experimental student! together^ vhlle the Ia«t tw grcH^p Controls together. This 
contrasts with laost tabular presentaticcji is. thia report iz i^hich the grouping is 
by teacher type. The present grouping It to highli^t alfferences in the corre- 
lational patterning in the data for the tvo types of stuceats. Differences in 
correlation pattern between Experimental anc Control stuces^ts are acre prominent 
than differences related to teacher type. It can be seen that for both student 
groups the "Moutnlng Objects'' category 0©) seesns to b^ only slightly related to 
the total inappropriate behavior score* r*ius, it vould appear that the HO category 
is different from the other behaviors and perhaps should not be considered as an 
inappropriate behavior i at least in the sa&ie sense the othars are. In Table 12 > MO 
was shovm to be one of the most frequ«itiy observe ''inappropriate*' behavior 
categories ^ bur the correlational data su.jggeat that such behavior occurred over all 
groups in a manner unrelated to the other types c: behavior observed • Of course, 
the reader should not interpret this discussion as suggesting that mouthing objects 
is appropriate behavior. In contrast to tbase <^servatiocs about MO behavior » 



cattgorlM D and C> whllt of quite lev freqatncy irx l4blt botfc correUt* 
fiilrly highly vith the totti in*pprDf:ri*t^ i«e.avicr «ccr« I: :;u> it zutitz 

that, In gtntrali the corrtlelional patter-:; it highly aisxiar ittveen pr«-ttfct 
and poac^^tast for all, groupa 

Probably tha major point to be notad m Table U la the dxfiate::xca bttvaas: 
Expartmantal and Control corralationai pattarna. For the Eocparx^nial arucisnt* 
Diaturbanca of OtharVi Property (D) and Turt:ltL| Around (tA) axe fairly closely 
related to ovarall acora» vharaaa for Control atv^anta thaaa rw^ catagories si^^ 
vary little relatlonahip to total acore Thare la aooe evidence chat tha Gr^a 
Motor category (GM) la laaa cloaely related to total tcore for the Co::trcla than 
for the Experiaantalai but the contraat xa not aa mrked at fcr the D anMi Za 
categorlea* While aooHivhat beyond the accpe of the praaent evaluation^ a factor 
analytic atudy of thaaa componenti of the inappropriate behavior accre vculd be o 
Intaraat. Tha preiant data strongly auggest qu«lxtative differencaa m the 
behavior of the two groupa of atudents 

Intern-School Differencaa 

The second year's evaluation report took note of mter-achool differencas- 
Aa might ba expected^ the data auggeated teachers m certain achocla aaeaec to ?r 
duce reaulta different froa those m ether achools. Table 15 preaents pre- and 
poat^taat maana by teachar<*atudent group for the 1973-7% data. Ihoae schools fcr 
which no data are preaanted are those m which the observer was unav^cica.hly ahsec 
during the poat-*taat data collection period Alac» the reader should n^tt tt*M,i 
thare la no correspondence between the niaber giv«n a srhocl m Table *5 vith zht: 
nii»ber given that school in the siciilar table m the aeccnd-year report This i» 
to preaarve the anonymity of school identification. 
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i«ctti v4r;ou* $cnooU in che obtervatior* C4r* T^t a-e^riitxg c: ties* ci:f«r«QC«», 
";:^«iv^r. ;^ aot clear Fir^t or it m^t i>e r#otec zzai th« 3;*^^:^ \xx Xtblt 15 

4rtt ^44*<ta ^ct ^m^l Jfc3», often quite 6^4111 t^trefcre^ it v^uli i^e *^wxi^e to inter- 
?ret tai^n a«ia.ni$ 4^ reliablt itxdxce* of the **bei:*v:,or*I clxs^te^^ or a gives school, 

^ac.*c:tealT chert *re dlttereaces in behavior*! cluiAtft ^tsoi::^ the 13 schools • 
i^'T^ittcl'' » iac«r-^cs%er/er differences m cbservation pr4cti:«4^ axe cctifcu:i<ie<i vlth 
:.^t«r^$icnocl alf:erence» Finally, It should he notei that the *3 schools did not 
^^.^ciii <4 reliable pattern over the cvo yeers in which the c^t* have heen analyzed. 
5-' ^ztocl^ rhere were socse consistencies' fros year tc year — for exaspXe, Schools 
1 %zc * ^i.ncwea rather low ziean scores over hcth years, wjiile Schools 3 and S shoved 
r«^^-i/«l7 ^"^1^* aeans* but there vera also nuaerou.s chary|es m relative position 
:rcia ^ae year tc the next. A larger data base m each school vould he required for 
^an:.^^:.*! inter-^school conclusions to be dravn* 

JrdC^ lavel Differences 

In si^xilar fashion, the deta were exaaiaed by grade level those data are 
reaorteo. 1:1 Tahle Id? Since no fir&t-^grade students vere involved In the data 
.^••itc:;;jn> cne table covers only grades 2-6, As can be seen fro^i the "all 
c ^nii 1 -^n^s ''«.o -4- M^s^n , the g en eral inverse re-ii-ationship he r^^e en grade .^eve^ and 
^mc^z zt inappropriate behavior noted in the seconc year report vas .0 found 
\z zr,^ 1^ aata the higher the grade level, the less the aacunt of inappro- 
;-iate 3ttna:vi3r ii» likely to be. this is not tc say that inapprcpriate behavior 

a le^* s.eri:3us prcble© at the upper grade levels; it nay, in fact, be ncre 
*e*:5u*i ewe tc :hanges in the nature of the behaviors concerned H^'ev^r, in tertiis 

tr:« rreq^^encies of behaviors of the t>T>es sfodied here, there is a general 
ri4:r«4^« 1^ :re<iuency with increasing grade level- t^is is vhat is expectea as a 
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McAu Nuaber of Inapproprimtc Behavior Categori«» 
Observed by School mnd Te*cher-Stv«ient Gro^^p 
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Me^ii Number of Inappropriate Behavior Categories 
Observed by School and Teacher-Student Group 
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Table 26 

Mean Number of Inappropriate Behavior Categories 
Observed by Grade Level and Teacher-Student Group 
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Mean Number ot Inappropriate Behavior Categories 
Obaerved by Grade Level and Teacher-Student Group 
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function of behavioral and psychological maturation as well as from the behavior- 
specific learning that school exposure produces by design. 

Workshop Performance and Stvjdent Behavior Change 

Among the most interesting results of the project's first two years has been 
the relationship between BR teacher performance in the contingency management work- 
shops and student behavior changes as reflected in the classroom behavioral obser- 
vation data. At the time the workshops were given, the instructors were asked to 
rate the teacher participants in terms of the likelihood that they would utilize 
the contingency management techniques effectively in their classrooms. Such 
utilization, or lack thereof, might reasonably be expected to be reflected in the 
behavior of students in their classes. Accordingly, the BR workshop participants 
were dichotomized into "High" and "Low" groups on this basis. These two groups 
were, in turn, further dichotomized into two groups each. The two High groups then 
were labeled "+ +" and "■»-," while the two Low groups were labeled and "- 
Thus, the + + group represents the upper quarter of the teachers on this classi- 
fication, and the group represents the bottom quarter. Behavioral data were 

then examined as a function of these groupings. 

The 1973-74 data were examined in similar fashion. Table 17 shows the break- 
out of pre- to post-test increase or decrease in inappropriate behavior for 
Experimental students as a function of High versus Low teacher workshop classification. 
Table 18 presents similar data for Control students. Table 19 depicts data for 

Experimental students as a function of the "+ +" versus " " teacher groupings, 

while Table 20 presents Control student data for the "+ +" versus" " teacher 

groups. Tables 21-24 present mean behavior frequencies for the pre- and post- 
test observations for these same teacher groups. 
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TtAcher Workshop 
CIag«lf Icatlon 

High 

Low 



TahU 17 

Student B«h«vlor Chang* by Teacher 
Workshop Perfomance CXaaslficatlon 
(Experimental Students) 

Change in Inappropriate Behavior 

Increase Decrease 



Totals 
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27 
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- 0.003 p > .99 



Teacher Workshop 
Claaslflcatlon 

High 
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Table 18 

Student Behavior Change by Teacher 
Workshop Perfomance Classification 
(Control Students) 

Change In Inappropriate Behavior 

Increase Decrease 

15 
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14 
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20 23 
(2 - O.U p > .70 



Totals 
29 

li 

43 



Teacher Workshop 
Classification 



Table 19 

Student Behavior Change by Teacher 
Workshop Performance Classification 
(Experimental Students) 

Change In Inappropriate Behavior 

Increase Decrease 



Totals 
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8 13 
2.04 p < .20 > .10 



75 



Totals 
12 

21 



Table 20 

Student Bcthavlor Change by Teacher 
Workshop Perforaaz^ce CXaaalflcatlon 
(Control Students) 

ChanEe in Inappropriate Bahavlor 

Teacher Workshop 

Classification Increase Decrease Totals 

+ 6 4 10 

Jl ^ \± 

Totals 12 7 19 

- 0.09 p > ,75 



Table 21 

Mean Pre- and Post'Test Behavior Observation Scores by 
Taacher Workshop Performance Classification 
(Experimental Students) 

Means 

Teacher Workshop 
Classification Pre-Test Post-Test 

High 1.18 1.24 

Low 0.93 0.91 
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Table 22 

Mean Pre- and Post-Test Behavior Observation Scores by 
Teacher Workshop Performance Classification 
(Control Students) 

Means 

Teacher Workshop 
Classification Pre-Test Post-Test 

High 0,76 0.69 

Low 0.93 0.86 
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M««n Pre- «n<l Poit-Ttat Behavior Obaervatlon Scores by 
Teacher Workshop Performance Classification 
(Experimental Students) 

Mesns, 

Xeach%r Workshop 
Classification Pre- Test Post-Test 

■f + 1.29 K15 

1.05 1.06 



T<ible 24 

Mean Pre- and Post-Test Behavior Observation Scores by 
Teacher Workshop Performance Classification 
(Control Students) 

Means 

Teacher Workshop 
Classlflcatjon Pre-Test Post-Test 

+ -f 0.65 0.63 

0.79 0.89 

As can be seen» none of the Chl-squares for the frequency data in Tables 
17-20 reaches the required 5X level of significance, though the comparison of 

ExperlroentAl students of + and teacher groups approaches significance. 

Similarly, none of the cpaparlsons of means vithln teacher groups (i.e., pre-test 
versus poKt-test) or across teacher group (e.g., post versus post — ) reaches 
the 5X level with the exception of the cosqpsrison of post- test mean for Control 
students of 4- -f teachers (M - 0,63) with the post-test mean of Control stv4en\:s of 
— teachers (M - 0.89). This letter comparison yielded t - 2.40. Post^test 
mean comparisons of Kii^h versus tow teachers approached significance for both 
Experimental students (t • 1.83) and Control students ( t » 1.84). In general, 
the trend of these results Is the same as the previous years' results, but the 



r«I«tlon«hlp btcwcen CftAcher workshop performance end student behavior Is not as 
pronounced in the 1973--74 data. 

On the basis of the three years of the project, it would appear that the 
effect that the teacher's classroom management practices has on the behavior of 
the students is related to whether or not the teacher participated in the special 
in-servlce trsining and how the teacher participated in that training, particularly 
the contingency management portion of that training. Of course, it is likely that 
selection factors were operating, and that the more effective teachers after work- 
shop training may also have been more effective than their peers before the work- 
shop training. However, that is speculative since no aata exist in this evalu- 
ation that can be used as a pre-workshop index of teacher performance. The data do 
support, though, the contention that the BR teachers, over the three years of the 
project, did tend to perform better, in terms of student outcomes, than did the OT 
teachers, and that the better performers in the contingency management workshop 
tended to produce better student behavioral outcomes than did those teachers who 
performed less well in the workshop. 

Attendance Data 

A final area of student performance, school attendance, was examined. As was 
found In past years, there were no significant differences in student attendance 
data as a function of teacher group. The only significant difference found was 
between Experimental and Control students, a not unexpected result. As a matter 
of information, attendance data are given in Table 25. Data from the preceding 
school year, 1972-73, are used as pre-test data, and those from the current year, 
1973-7A, comprise the post-test data. 

It should be noted that the data in Table 25 are based on slightly smaller 
Ns than the behavioral data post-test sample. This was due to the fact that 




Tabu 26 



Mean Student Absences by Teacher-Scudenc Group and Year 



Teacher Group 



Building Representatives 



Other Teachers 



Student Group 



1972-73 



1973-74 



1972-23 



1973-74 



Experinentals 



6,55 



6,54 



7.29 



7.31 



Controls 



4.19 



5.37 



5.59 



5.75 



certain students' attendance records could not be secured in time for this report. 
However, the Ms represent approximately 95X of the original samples, so they likely 
present an adequate picture of the total post-test sample. 

SUMMARY OBSERVATIONS 

Since this is the final year of the Comprehensive Services project, it is 
appropriate to review the principal objectives of the project and its accomplishments 
with reference to those objectives. Some of the comments are based directly on the 
evaluation data presented in this and previous reports, while others are based on the 



general observations of the evaluation team, over the three years in which they have 
interacced with the students, teachers, principals, and project staff, as well as with 
the Do than City Schools adndnistrativa staff. 

While certain acknowledgements are made in the Preface to this report, further 
note should be made of the excellent efforts of those concerned with the project i 
particularly the classroom teachers. They must be the real agents of change and 
progress in public education, for it is they who provide the most frequent and the 
most effective interface with the focal point of the education cystem, the students 
themselves. 

Education is an institution and, for that reason, it changes slowly. In recent 
years there has been much attention given to educational changes such as new books, 
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TV^ multlmedlA inaCructlon, computer-assisted instruction, etc., but, Important 
'hough these changes may be, it Is still the teacher who Is the most Important and 
^•■"fective aspect of any innovation or change in education. Therefore, it is 
■jppropriate that projects such as the present one recognize the teacher's role and 
attempt to effect constructive system changes through the medium of the teacher. 
In the present case, the teachers were certainly the critical ingredient In the 
benefits achieved. 

Obviously, not all project objectives were completely accomplished, but the 
project did make significant progress and has resulted In changes that will continue 
atter the project's termination, lu terms of the various categories of project 
::bjeccivea outlined In Chapter III, the following summary observations are offered. 

Student-Related Objectives 

The principal objectives of the Comprehensive Services for Children project 
were those related to students. With reference to producing beneficial changes In 
ihe behavior of those students of main concern to the project, those with socio- 
emotional conflict problems, the data over the three years of the project indicate 
chat these students did benefit. Their behavior tended to become more appropriate 
tor the school situation as a result of the training given the teachers. While 
there were some conflict students whose behavior was unaffected, the data suggest 
very strongly that the program did help the conflict students, and that it 
benefitted the non-conf lict students as well. Further, there is some suggestion 
rb't the benefits are cumulative and carry over from one year to the next. It 
would be improper to conclude that all children benefitted from the program, or that 
major or spectacular benefits for individual children were commonplace, chough there 
were such Instances. However, it is felt that the Comprehensive Services project 
has, in large part, made progress toward this major objective area. Improving 
student behavior. 
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In contrast, the data do not indicate aivy iubsta;;itial programs with rafarence 
to student objectives such as licpro%'ed acadi^c ^chi^xmsMx^t or isrprcvad at tendance • 
Againi on an individual case basis there have bee:^ sor^ substantial improvements » 
but on a group basis this has not been the case. As ncced in the report i this is 
not too surprising since acadesac achiev«seat vas aot the principal goal of the 
project* 

Overall » the project has :&ade significant projress tovard the accomplishment 
of its student-related objectives. 

Staff- Related Objectives 

It follows^ at least to some extent, that if there vas progress in the 
accomplishment of student*reiated objectives ^ there progress in the accomplish- 
oent of staff-related objectives. There b«ve be.«iv chxz^ts la. staff capabilities 
resulting fro» the project. The ter» "turtuc«ryli:,g" caa be applied to the manner in 
which the project has produced nev skills as^d ioiovlftiie vlth the elementary staff 
that will continue to operate in the future. 

The extent to which staff-related objectives vere accosiplished with indi- 
vidual teachers varied widely. As the project lavolvmc aore and too re of the 
population of elementary teachers, the staff b-esefits fros the in-service training 
program probably declined for the newer participants. This is probably inevitable 
for any teacher educational prograa involving new practices in which the initial 
trainees are volunteers » but in which later stage participation is progressively 
less voluntary. 

While the staff objectives have been r^ibstantlally accoatplished for the teaching 
staff, progress in developing a group of ceatral staff personnel with in-depth 
expertise in the areas of interest has not be«4 accos?Jlisn«d as well. Lack of funding 
with a resulting reduction in central staff resource personnel and staff turnover 

68 w 



Ate tht principal reA«ons« Such mticert vtrt Ij^gtly btyoni the contrcl of t.he 
project staff, and were not related to the i:uAz.T^tT iri vt;ich the prcjject va^ cott- 
celvcd and designed t^evertheie^s* thl5 particular asp^vt of the sitaf f*related 
objectlveii waa not accompllahed in a manner tuci; aa to reault in turukeying aix 
in-depth resource group back into the ongoing ayates, 

Parent-Related Objectives 

Involvement of parents on a progras basis vas difficult. Involvesenc tencec 
to be related to individual problem situations* There vere, of course t numerous 
communications with parents by the teachers and other agents of rhe school sysres:, 
but it was not possible to implement a program of parent involvement a^B an integral 
part of the Comprehensive Services project per se* Ihe evaluation design re^quxre*- 
taent for not div\ilging the identity of the target stuci^ts further cosspllcatetc this 
matter* Fur these reasons > parent involvement: vas largely on an individual basis* 

A parental involvement with the program which is vorO^y of note was the part 
played by the classroom behavior observation team* Their participation was, of 
course > not related to the type of intervention objectives described cnder the 
"parent'-related*' heading. However » the observers* who were parents of children 
in the school system^ made a significant contribution to the projecx* Their 
participation is one example of the many ways in wnich parents cmz work cooperatively 
with the schools in achieving common goals « 

Community-- Re la ted Objectives 

An active program of disseminating information to the ccrsEunity was conducted • 
The project was given much favorable publicity, as for ex a mp le when it received 
national recognition by the Department of Healthy Education > and Welfare as an 
^i*xemplary program. Also^ tnere was a vigorous effort to ijitegrate the activities 
of all the helping agencies in the community through the formation of a Human Resources 
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Z^^cil. TixiM Ccuascil provided a focil point for inttrajfer-cy rtftrr*!, «rvtc< 
«li^rr^ aK>f€rativt projtct». 

^rta4iily> *atR» of tht 4dmlnistr*t:loxi-r«l*teG crbjtcilvei of th« pr^jmct v«r« 
*c::r.':aBjsI.tjf.&«i». A profraa a»d«I for atetls^f the t^^cj of a «lfsiiflc«it group of 
cnj^lxrro: v«i atv^«Iop*4t tmples>entt4, «id ev^luateu* S;,^rir.te::d«it has avail- 

lorormatioQ about program coits and outc<ne.s» and about program strengths and 
^i9Nu»ieti'j9Htti f on the ba9.ls of which ha can isake future plans « ^-ecesaarily » such 
is^^rsiatlan is always Inconiplete. The critical questioc is vhether tha infonaation 
Uk r^ticxasxt to axd the decialc^-iaaking, process of the schc<X actet^xistrator* In 
all» It iji f^tlt that a sound data base has bean provaded for such decisions* Ii»e 
4nxL t'^tuxa students provide the ultimata ans^i^ar as to its adequacy* 



APPENDIX A 
EXCEPTIONAL STUDENT RATING FORM (ESRF) 
PUPIL RATING FORM (PRF) 



DOTUAN Cin SCHOOLS 
Room Rating Form 
Exceptional Student Rating Form 

School Grade 



Rating Teacher Date 

INSTRUCT I DNS : Read each paragraph below and indicate by name any pupil 
or pupilb xn your room this school year who tend to act in the manner described. 
No pupil will act aa illustrated m ail respects, but there may be one or more 
m your room who generally act m the manner described- If so^ list them In 
order m the i>pace^ provided It there are more than tour pupils who fit a 
particular paragraph, list only the tour who besr f j.t it. You roiiy have less 
than four to list tor one or more ot the paragraph&t and you may list any 
pupil under more than one paragraph- 



A child who i& AGGRESSIVE commits one or more of the following kinds of 
actb with relative trequency; hitting, punching, kicking, slapping, striking 
with hands* or objects; throwing objects at others; pulling hair, disturbing 
others* books, desk, etc.; destroying another's property. If there were 
pupils m your room this year whom you consider particularly AGGRESSIVE, list 
them below m oider. 

Most aggressive 

Second most aggrf.ssive ^ 

Third most aggressive 

Fourth most aggressive 



A child who is VERBALLY DISRUPTIVE commits one or more of the following 
kinds of acts with relative frequency: talks to others when not permitted; 
interrupts teacher; interrupts other pupils' recitations; calls teacher's 
name to get attention; laughs, coughs, etc., to get attention; makes frequent 
"wise cracks'* m class If there were pupils in your room this year whom you 
consider particularly VERBALLY DISRUPTIVE, list them below in order • 

Most verbally disruptive 

Second most verbally disruptive 

Third most verbally disruptive 

Fourth most verbally disruptive 



Room Raiting Form - 2 

A chxld who IS SOCIALLY INSECURE commits one or more of the following kinds 
of actb with relative frequency: speaks m a vtry soft voice; avoids playing 
with other pupils; speaks m halting voice; keeps to self; contributes to class 
only when called upon; remaint* in seat more than most pupils; avoids being first 
at anything; shirks from notice. If there were pupils in your room this year 
whom you consider particularly SOCIALLY INSECURE* list them below in order* 

Mo»t socially insecure 

Second most socially insecure 



Ihird most socially insecure 



Fourth most socially insecure 



A child who IS BEHAVIORALLY DISRUPTIVE commits one or more of the following 
kinds of aces with relative frequency: gets out of seat without permission; runs 
and/or jumps around the classroom and halls; rocks seat; taps pencil; drops books 
touches other pupils' desks. If there were pupils In your room this year whom 
you consider particularly BEHAVIORALLY DISilUPTIVE, list them below in order. 

Mosc behaviorally disruptive 

Second most behaviorally disiruptive 

Third most behavlroally disruptive 

Fourth most behaviorally disruptive 



A child who has LOW SELF-ESTEEM commits one or more of the following kinds 
of acts with relative frequency: professes inability to do assignments; fails 
to undertake assigned work; exprecises self --criticism; avoids competitive 
situations; avoids responding to the teacher's questions; turns in assignments 
lace; takes more time to answer questions than most other pupils; expresses 
satisfaction with poor performance. If there were pupils in your room this 
year whom you consider to have particularly LOW SELF-ESTEEM, list them below 
m order- 

Lowest m self-esteem 



Second lowest in self-esteem 



Third lowest in self-esteem 



Fourth lowest in self-^esteem 
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Room Rating Form 



A child who is EMOTIONALLY OVER'-REACTIVE commits one or more of the 
toUowmg kinds of acts with relative frequency: cries; soils clothes; 
li)ses temper; throws things (not necessarily at people); destroys things; 
over reacts to criticism; shouts at others; accuses others when anything 
goes wrong. If there were pupils in your room this year whom you consider 
particularly EMOTIONALLY OVER«REACTIvk , list them below in order • 

Most emotionally over-reactive 

Second most emotionally over--reactive 

Third most emotionally over--reactive 

Fourth most emotionally over^reactive 



DOTHAN CITY SCHOOLS 
Pupil Rating Form 

INSTRUCTIONS TO RATING TEACHER 

This rating form consists of pairs of generally favorable and generally 
unfavorable words — one of each per pair. Each pair defines the limits of a 
continuum or scale describing some aspect of behavior, personality, or 
adjustment. Every pupil can be described in terms of his placement at some 
point on each continuum or scale. Your task is to circle a number from "1" 
to "7" — to describe each of your pupils on each of the scales listed. Circling 
the number "1" indicates that, in your opinion, the pupil is best described by 
the more favorable of the two words, l,e. , the word on the left. Circling the 
number "7" indicates he is best described by the less favorable word, Tou may 
circle any number "2" through "6" to Indicate that he is soraewhere between the 
two tactremes. The numbers "2" and "3" are favorable, while "5" am "6" are 
unfavorable, and "4" is about midway between the two extremes. Please be sure, 
however, to look at both words defining a scale before making your Judgment. 
Moat pupils will probably fall toward the more 'favorable end of the scales. 
Examples of the scales are shown below. Please complete one answer sheet 
(all scales) for each pupil cutrrently enrolled in your class. Mark only one- 
number of each scale. ^ 

EXAMPLE 

igraaiAle 1 2 3 4 5 6 7 disagreeable 
happy 1 2 3 4 5 6 7 sad 
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DOTHAN CITY SCHOOLS 
Pupil Rating Form 



Pupil School 
Teacher Grade 



agreeable 


1 


2 


3 


4 


5 


6 7 


disagreeable 


happy 


1 


2 


3 


U 


5 


6 7 


sad 


friendly 


1 


2 


3 


A 


5 


6 7 


hostile 


sociable 


1 


2 


3 


4 


5 


6 7 


withdrawing 


cooperative 


1 


2 


3 


A 


5 


6 7 


antagonistic 


secure 


1 


2 


3 


4 


5 


6 7 


anxious 


industrious 


1 


2 


3 


4 


5 


6 7 


lazy 


self-confident 


1 


2 


3 


4 


5 


6 7 


timid 


trustworthy 


1 


2 


3 


4 


5 


6 7 


deceitful 


easy-going 


1 


2 


3 


4 


5 


6 7 


quarrelsome 


attentive 


1 


2 


3 


4 


5 


6 7 


inattentive 


adaptable 


1 


2 


3 


A 


5 


6 7 


non-conf ormlng 


energetic 


1 


2 


3 


4 


5 


6 7 


listless 


even-tempered 


1 


2 


3 


4 


5 


6 7 


bad-tempered 


cheerful 


1 


2 


3 


A 


5 


6 7 


depressed 


obedient 


1 


2 


3 


4 


5 


6 7 


defiant 


courteoua 


1 


2 


3 


A 


5 


6 7 


disrespectful 


cautious 


1 


2 


3 


A 


5 


6 7 


impulsive 


flexible 


1 


2 


3 


A 


5 


6 7 


compulsive 


mature 


1 


2 


3 


A 


5 


6 7 


infantile 


calm 


1 


2 


3 


A 


5 


6 7 


restless 


compasslonete 


1 


2 


3 


A 


5 


6 7 


malicious 


tractable 


1 


2 


3 


A 


5 


6 7 


stubborn 


modest 


1 


2 


3 


A 


5 


6 7 

8.9 


arrogant 



APPENDIX B 
CATEGORIES OF STUDENT BEHAVIOR 
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CATEGORIES OF STUDENT BEHAVIOR FOR. USE OF 
DOTHAN CITY SCHOOLS OBSERVERS 



V M.t^r Geitmg out of 8eat» standing up, running, hopping, skipping, 
:ump:,ng, walking around, moving chairs, disruptive movement without noise, 
linking at (but not touching) others, etc* 

iJ. :.6t^ Tapping pencil or other objects, clapping, tapping feet, 
r.it»Ung or tearing paper, throwing book on desk, slimming desk. (Be conservative, 
r t^i? vnly it you ran hear the noise with eyes closed. Do not include accidental 
dr ^pp ;ng cf objects . ) 

'.r*4:'t:.:n*e cf Other's Property, Grabbing objects or work, knocking 
neighbor's books or other items off desk, destroying another's property, pushing 
wiih desk (rate only if someone is there), throwing objects at another person 
Without hitting themv (Do not include accidental disturbance of other's property.) 

v^'ajt Hitting, kicking, shoving, pinching, slapping, striking with 
objeci, throwing object which hits another person^ poking with object, biting, 
polling hair, touching, patting, etc, (Any physical contact is rated.) 

V^rializatioYis Carrying on conversitions with other children when in- 
appropriate Answering teacher without raising hand or without being called on; 
making comments or calling out remarks when no questions have been asked; calling 
teacher's name to get her attention; crying, screaming, singing, whistling. 
Laughing, coughing, or blowing loudly. (These responses may be directed to 
teacher or children or r.hey may be undirected.) ^ 

■p^ArKiKj Around. Inappropriately turning head or head and body to look at f. 
another person, showing objects to another ch'ld, attending to another child. 

(Must be 01 4-sec. duration, or more than 90 degrees — using desk as a i 

reference. Not rated unless seated.) ^ 

.V uth:^:g Objects. Bringing thumb, fingers, pencils, or any object into 
cjntact with the mouth. 

Othf^r Inappropriate behavior. Ignoring teacher's question or commaiid. 
Dolag something different from that directed to do, including minor motor behavior 
^uch as playing with pencil or eraser when supposed to be writing, coloring while 
a record is on, doing spelling during the arithmetic lesson, playing with objects. 

:he ^hi^. i involves himself in a task that is not appropriate. 

Api r^pr:.::te Behavior. Time on task, e,g., answering questions, listening, 
rinsing hand, working on assignments. (Must include whole observation interval 
ex.ept for Turning Around responses of less than 4-8ec. duration.) 



^These categories of student behavior were adapted from "Behavioral Coding 
Categories for Children" in the article "Rules, Praise, and Ignoring: Elements 
of Elementary Classroom Control," by Charles H. Madsen, Jr., Wesley, C. Becker, 
and Don R. Thomas, (Florida State University and University of Illinois), 

/j'.rn^' c; Applied Behavior Analysis^ 1968, I, 139^-150. 
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APPENDIX C 
DOTHAN CITY SCHOOLS OBSERVER DATA FORMS 




DOTHAN CITY SCHOOLS OBStRVER DATA FORM 



Scnool 



Teacner 



Uliberver 



Grade Day of Week_ 

Room Time 



NAMf 








o 






^^ 








r 




















2 


















i 


9 




















4 


















) 


9 










































NAMI 








o 




>i 










1 




















2 




















3 




















4 




















5 









































Obs. f-io. 



Date 



NAME 






o* 


0 


o 












1 








• 












2 




















3 




















4 




















9 




















4 





















NAME 






0* 


o 




>l 










1 




















2 




















3 




















4 




















S 




















1 





















NAME 




o* 


o 










X. 




1 




















3 




















3 




















4 
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6 






















NAME - ALTERNATE 










0 












1 




















2 




















3 




















4 




















5 




















6 
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GM - Gross Motor 
ON - Object Noise 

D - Disturbance of Other's Property 

C - Contact 



V - Verbalization AB - Appropriate Behavior 
TA - Turning Around 

MO - Mouthing Objects qo 
01 B - Other Inappropriate Behavior 
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STUDENT DATA WttKlY SUMMARY SHEET 



OBSERVATION 



Student 

School 

Teacher 



Grade 



BR 
1 2 3 



OT 

StutJent Group 



Observer No. 



MON 



TUE 



WEO 



THUR 



FRI 



TOTAIS 



**• 


0* 


0 


0 


4 






9^ 


TOTAIS 


















4 


















4 





































4 







































ERIC 
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APPEKDIX D 

INTERCORREUTIONS OF PRE- AKD ?OSI-rEST 5EE,\VICR CATEGORIES 

1. BUILDING REPRESEKTATITES - ESPERIXEyrAl STTDEyiS 

2. BUILDING REPRESENTATIVES - COhTSCl STTTEJiTS 

3. OTHER TEACHERS - EXPERIKENTAl S^v^DESTS 
A. OTHER TEACHERS - CONTROL SrUTSCTS 
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3.33 


2,76 • 


0.23' 








r 1 


1 1 1 
' 6,23'^ 


■ 2 












1 ( i i 

: S.ItI jQ^.I J-^^ 



1NTERCORR£LATIONS OF PR£- AND POST-TEST BEHAVIOR CATEGO' 
BUILDING REPRESENTATIVES-CONTROL STUDENTS 
{N-99) 



PRE TEST 



MS 



CM 



ON 



«0 



OIB 



Cat . 



P 
R 
E 



T 

E 
S 
T 



P 
0 
S 
T 



T 

E 
S 
T 



Cttiii» Hotor 
Object NoitttJ 

UlMturb <»thcr'«i Property 

Turning ArouiiU 
OchM ln«pp. Behavior 



(;m 

ON 



Total C icegor led 
Total Obttcrvnt ions* 
Overall M«an 



Gro«t> Motor 
Object ^^ol^*c 

DlHCurt Othfr's Property 
Contact 
VerbdiU zat Ion 
Turning Aroun*! 
Mouthinjt )i»ci b 
Uth«r .napp. iiehavior 
Totfil t4tf)iorleii 
Total ' ^bstfi'^'at 1 
Ov<»rAll Mean 



V 

Mu 
Olb 
Cat • 

: obi*, 

0\i\\ X 
CM 
ON 
I) 
C 
V 
TA 
MO 
OIB 
' ( at * 
ObH , 




.13 



-.01 



.17 



.06 



-.01 



.30 



.51 



.12 



.1m 



.11 



-.07 



.06 



.49 



16 



.60 



.32 



,61 



.09 



.00 



,06 



.01 



'.00 



.17 



.IB 



.12 



,20 



,33 



.51 



• 14 



.47 



.36 



• 58 



• 97 



• 00 



GW ON 
t 



.29 



,10 



12 



• 1.. 



.06 
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.03 



.23 



.37 



• Ob 
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,14 
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.37 



.2B 



•-.10 



.33 



.06 



.01 



.13 



.08 



.28 



-*.08 



•,05 



.16 



.17 



-.01 



,17 
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GM 


ON 


D 


c 


V 


TA 


MO 


OIB 


r 

Cat. 


I 

Obs* 


O'all 
X 


GM 


ON 


D 


C 


2.71 


1.94 


0.16 


0.58 


5.26 


2.74 


6.72 


4,59 


24.69 


28.72 


0.86 


1.96 


1-73 


0.10 


O.33I 


2.33 


1.81 


o,s.s 


0.B6 


4ai 


2*96 


4.06 


4. 49 


10,28 


2.85 


0.35 


1.94 


1.87 


0.53 


0.6. 



IHTE^ICORREIATIQNS OF PRC- AK2 ^^T^^tS^ UmivK a^C&CSICS 
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